09:58:33,883 DEBUG (testng-Test:[]) [TestNGTestListener] After setup testClassStarted 09:58:33,883 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeClass 09:58:33,883 DEBUG (testng-Test:[]) [Test] Creating cache managers 09:58:33,884 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: ModuleLifecycle 09:58:33,889 DEBUG (testng-Test:[]) [ServiceFinder] Loading service impl: CoreTestMetadataFileFinder 09:58:33,893 DEBUG (testng-Test:[]) [ServiceFinder] Loading service impl: TestModuleCommandExtensions 09:58:33,893 DEBUG (testng-Test:[]) [ModuleProperties] Loading module command extension SPI class: org.infinispan.remoting.rpc.TestModuleCommandExtensions@3a2a5414 09:58:33,898 INFO (testng-Test:[]) [JGroupsTransport] ISPN000078: Starting JGroups channel ISPN 09:58:33,902 DEBUG (testng-Test:[]) [Configurator] set property TCP_NIO2.diagnostics_addr to default value /224.0.75.75 09:58:33,902 TRACE (testng-Test:[]) [NAKACK2] null: set max_xmit_req_size from 0 to 247600 09:58:33,902 TRACE (testng-Test:[]) [UNICAST3] null: set max_xmit_req_size from 0 to 247600 09:58:33,904 TRACE (testng-Test:[]) [MessageDispatcher] setting local_addr (null) to Test-NodeA-7051 09:58:33,904 TRACE (testng-Test:[]) [STABLE] Test-NodeA-7051: stable task started 09:58:33,904 TRACE (testng-Test:[]) [TEST_PING] Discovery.stopped=false 09:58:33,904 DEBUG (testng-Test:[]) [GMS] address=Test-NodeA-7051, cluster=ISPN, physical address=127.0.0.1:7900 09:58:33,908 TRACE (testng-Test:[]) [TEST_PING] Added discovery for Test-NodeA-7051. Registered discoveries: {Test-NodeA-7051=TEST_PING@Test-NodeA-7051} 09:58:33,908 DEBUG (testng-Test:[]) [TEST_PING] No other nodes yet, marking this node as coord 09:58:33,910 TRACE (testng-Test:[]) [GMS] Test-NodeA-7051: no members discovered after 2 ms: creating cluster as first member 09:58:33,910 DEBUG (testng-Test:[]) [NAKACK2] [Test-NodeA-7051 setDigest()] existing digest: [] new digest: Test-NodeA-7051: [0 (0)] resulting digest: Test-NodeA-7051: [0 (0)] 09:58:33,911 DEBUG (testng-Test:[]) [GMS] Test-NodeA-7051: installing view [Test-NodeA-7051|0] (1) [Test-NodeA-7051] 09:58:33,911 DEBUG (testng-Test:[]) [STABLE] resuming message garbage collection 09:58:33,912 TRACE (testng-Test:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1] 09:58:33,912 TRACE (testng-Test:[]) [TOA] Handle view [Test-NodeA-7051|0] (1) [Test-NodeA-7051] 09:58:33,912 TRACE (testng-Test:[]) [MFC] new membership: [Test-NodeA-7051] 09:58:33,913 DEBUG (testng-Test:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|0] (1) [Test-NodeA-7051] 09:58:33,913 INFO (testng-Test:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|0] (1) [Test-NodeA-7051] 09:58:33,913 TRACE (testng-Test:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1] 09:58:33,913 DEBUG (testng-Test:[]) [STABLE] resuming message garbage collection 09:58:33,915 DEBUG (testng-Test:[]) [GMS] Test-NodeA-7051: created cluster (first member). My view is [Test-NodeA-7051|0], impl is org.jgroups.protocols.pbcast.CoordGmsImpl 09:58:33,915 INFO (testng-Test:[]) [JGroupsTransport] ISPN000079: Channel ISPN local address is Test-NodeA-7051, physical addresses are [127.0.0.1:7900] 09:58:33,915 TRACE (testng-Test:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:33,915 TRACE (testng-Test:[]) [LocalTopologyManagerImpl] Starting LocalTopologyManager on Test-NodeA-7051 09:58:33,915 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:33,915 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [ClusterTopologyManagerImpl] Received new cluster view: 0, isCoordinator = true, old status = INITIALIZING 09:58:33,916 DEBUG (transport-thread-Test-NodeA-p23728-t1:[]) [ClusterTopologyManagerImpl] Recovering cluster status for view 0 09:58:33,916 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0}, mode=SYNCHRONOUS, timeout=24000 09:58:33,916 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:33,916 TRACE (transport-thread-Test-NodeA-p23728-t1:[null]) [JGroupsTransport] Waiting on view 0 being accepted 09:58:33,916 DEBUG (transport-thread-Test-NodeA-p23728-t1:[null]) [LocalTopologyManagerImpl] Sending cluster status response for view 0 09:58:33,916 DEBUG (transport-thread-Test-NodeA-p23728-t1:[]) [ClusterTopologyManagerImpl] Got 1 status responses. members are [Test-NodeA-7051] 09:58:33,916 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [ClusterTopologyManagerImpl] Updating cluster members for all the caches. New list is [Test-NodeA-7051] 09:58:33,916 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 09:58:33,916 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:33,915 DEBUG (testng-Test:[]) [DefaultCacheManager] Started cache manager ISPN on Test-NodeA 09:58:33,981 TRACE (testng-Test:[DistInitialTransferListener]) [DefaultCacheManager] About to wire and start cache DistInitialTransferListener 09:58:33,989 DEBUG (testng-Test:[DistInitialTransferListener]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:58:33,990 DEBUG (testng-Test:[DistInitialTransferListener]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:33,990 DEBUG (testng-Test:[DistInitialTransferListener]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:33,990 TRACE (testng-Test:[DistInitialTransferListener]) [TransactionFactory] Setting factory enum to NODLD_NORECOVERY_XA 09:58:34,000 DEBUG (testng-Test:[DistInitialTransferListener]) [JmxUtil] Object name infinispan-dc7adb85-b87f-4040-87d6-4a51a76e4104:type=Cache,name="DistInitialTransferListener(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 09:58:34,000 TRACE (testng-Test:[DistInitialTransferListener]) [DistributionManagerImpl] starting distribution manager on Test-NodeA-7051 09:58:34,007 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Starting StateTransferManager of cache DistInitialTransferListener on node Test-NodeA-7051 09:58:34,015 DEBUG (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Node Test-NodeA-7051 joining cache DistInitialTransferListener 09:58:34,018 TRACE (testng-Test:[DistInitialTransferListener]) [SemaphoreCompletionService] Moving task to background, available permits 1 09:58:34,018 TRACE (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeA-7051, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=38905a8b-122f-4ec5-822a-b8b876c300bd, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:34,024 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener initialized. Persisted state? false 09:58:34,028 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterCacheStatus] Added joiner Test-NodeA-7051 to cache DistInitialTransferListener with persistent uuid 38905a8b-122f-4ec5-822a-b8b876c300bd: members = [Test-NodeA-7051], joiners = [Test-NodeA-7051] 09:58:34,028 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterCacheStatus] Initializing status for cache DistInitialTransferListener 09:58:34,028 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]}, members = [Test-NodeA-7051], joiners = [] 09:58:34,028 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 09:58:34,029 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener stable topology updated: members = [Test-NodeA-7051], joiners = [], topology = CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,029 DEBUG (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterTopologyManagerImpl] Updating cluster-wide stable topology for cache DistInitialTransferListener, topology = CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,034 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051], throwable=null, viewId=0} 09:58:34,034 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051], throwable=null, viewId=0}, mode=ASYNCHRONOUS, timeout=240000 09:58:34,036 DEBUG (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterCacheStatus] Queueing rebalance for cache DistInitialTransferListener with members [Test-NodeA-7051] 09:58:34,036 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterCacheStatus] Rebalancing consistent hash for cache DistInitialTransferListener, members are [Test-NodeA-7051] 09:58:34,036 TRACE (testng-Test:[DistInitialTransferListener, DistInitialTransferListener]) [ClusterCacheStatus] The balanced CH is the same as the current CH, not rebalancing 09:58:34,036 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] Waiting on view 0 being accepted 09:58:34,036 DEBUG (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,036 TRACE (transport-thread-Test-NodeA-p23728-t2:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 0 09:58:34,036 TRACE (testng-Test:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 09:58:34,051 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} on cache DistInitialTransferListener 09:58:34,051 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] This is the first topology 1 in which the local node is a member 09:58:34,074 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = true, topology = CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,082 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferLockImpl] Signalling topology 1 is installed 09:58:34,085 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Unable to acquire cluster listeners from other members, assuming none are present 09:58:34,089 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:34,089 DEBUG (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener 09:58:34,089 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Finished adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener 09:58:34,089 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 09:58:34,089 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferLockImpl] Signalling transaction data received for topology 1 09:58:34,089 DEBUG (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:34,090 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Initial state transfer complete for cache DistInitialTransferListener on node Test-NodeA-7051 09:58:34,090 TRACE (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,090 TRACE (testng-Test:[DistInitialTransferListener]) [SemaphoreCompletionService] Background task finished, available permits 1 09:58:34,096 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] StateTransferManager of cache DistInitialTransferListener on node Test-NodeA-7051 received initial topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,096 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,110 TRACE (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:34,110 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Waiting for initial state transfer to finish for cache DistInitialTransferListener on Test-NodeA-7051 09:58:34,110 DEBUG (testng-Test:[DistInitialTransferListener]) [CacheImpl] Started cache DistInitialTransferListener on Test-NodeA-7051 09:58:34,110 TRACE (testng-Test:[DistInitialTransferListener]) [DefaultCacheManager] Closing latch for cache DistInitialTransferListener 09:58:34,111 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: ModuleLifecycle 09:58:34,111 DEBUG (testng-Test:[]) [ServiceFinder] Loading service impl: CoreTestMetadataFileFinder 09:58:34,116 DEBUG (testng-Test:[]) [ServiceFinder] Loading service impl: TestModuleCommandExtensions 09:58:34,116 DEBUG (testng-Test:[]) [ModuleProperties] Loading module command extension SPI class: org.infinispan.remoting.rpc.TestModuleCommandExtensions@6acd4f3d 09:58:34,122 INFO (testng-Test:[]) [JGroupsTransport] ISPN000078: Starting JGroups channel ISPN 09:58:34,125 DEBUG (testng-Test:[]) [Configurator] set property TCP_NIO2.diagnostics_addr to default value /224.0.75.75 09:58:34,126 TRACE (testng-Test:[]) [NAKACK2] null: set max_xmit_req_size from 0 to 247600 09:58:34,127 TRACE (testng-Test:[]) [UNICAST3] null: set max_xmit_req_size from 0 to 247600 09:58:34,127 TRACE (testng-Test:[]) [MessageDispatcher] setting local_addr (null) to Test-NodeB-10318 09:58:34,127 TRACE (testng-Test:[]) [STABLE] Test-NodeB-10318: stable task started 09:58:34,128 TRACE (testng-Test:[]) [TEST_PING] Discovery.stopped=false 09:58:34,128 DEBUG (testng-Test:[]) [GMS] address=Test-NodeB-10318, cluster=ISPN, physical address=127.0.0.1:7901 09:58:34,128 TRACE (testng-Test:[]) [TEST_PING] Added discovery for Test-NodeB-10318. Registered discoveries: {Test-NodeA-7051=TEST_PING@Test-NodeA-7051, Test-NodeB-10318=TEST_PING@Test-NodeB-10318} 09:58:34,128 TRACE (testng-Test:[]) [TEST_PING] Map Test-NodeA-7051 with physical address 127.0.0.1:7900 in TEST_PING@Test-NodeB-10318 09:58:34,128 TRACE (testng-Test:[]) [TEST_PING] Map Test-NodeB-10318 with physical address 127.0.0.1:7901 in TEST_PING@Test-NodeA-7051 09:58:34,111 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,170 TRACE (testng-Test:[]) [TEST_PING] Returning ping rsp: Test-NodeA-7051, name=Test-NodeA-7051, addr=127.0.0.1:7900, coord 09:58:34,187 TRACE (testng-Test:[]) [TEST_PING] Skipping sending discovery to self 09:58:34,193 TRACE (testng-Test:[]) [GMS] Test-NodeB-10318: discovery took 65 ms, members: 1 rsps (1 coords) [done] 09:58:34,193 DEBUG (testng-Test:[]) [GMS] Test-NodeB-10318: sending JOIN(Test-NodeB-10318) to Test-NodeA-7051 09:58:34,205 TRACE (testng-Test:[]) [UNICAST3] Test-NodeB-10318: created sender window for Test-NodeA-7051 (conn-id=0) 09:58:34,205 TRACE (testng-Test:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #1, conn_id=0, first) 09:58:34,205 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are GMS: GmsHeader[JOIN_REQ]: mbr=Test-NodeB-10318, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 09:58:34,210 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,238 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (86 bytes) 09:58:34,238 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] 127.0.0.1:7901: connecting to 127.0.0.1:7900 09:58:34,307 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_REQ]: mbr=Test-NodeB-10318, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 09:58:34,307 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #1, conn_id=0, first) 09:58:34,307 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: created receiver window for Test-NodeB-10318 at seqno=#1 for conn-id=0 09:58:34,307 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#1 09:58:34,314 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: joiners=[Test-NodeB-10318], suspected=[], leaving=[], new view: [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,314 DEBUG (ViewHandler,Test-NodeA-7051:[]) [STABLE] suspending message garbage collection 09:58:34,318 DEBUG (ViewHandler,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: resume task started, max_suspend_time=33000 09:58:34,318 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: mcasting view [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] (2 mbrs) 09:58:34,319 TRACE (ViewHandler,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#1 09:58:34,319 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 09:58:34,323 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: , src: Test-NodeA-7051 (3 headers), size=57 bytes] 09:58:34,326 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: , src: Test-NodeA-7051 (3 headers), size=57 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 09:58:34,326 TRACE (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: received Test-NodeA-7051#1 09:58:34,326 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (108 bytes (540.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:34,326 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (111 bytes) 09:58:34,326 TRACE (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: delivering Test-NodeA-7051#1-1 (1 messages) 09:58:34,330 TRACE (Incoming-1,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: received full view: [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,330 DEBUG (Incoming-1,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: installing view [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,330 TRACE (Incoming-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1] 09:58:34,330 TRACE (Incoming-1,Test-NodeA-7051:[]) [TOA] Handle view [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,330 TRACE (Incoming-1,Test-NodeA-7051:[]) [MFC] new membership: [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,330 DEBUG (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,330 DEBUG (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] Joined: [Test-NodeB-10318], Left: [] 09:58:34,330 INFO (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,330 TRACE (Incoming-1,Test-NodeA-7051:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,330 INFO (Incoming-1,Test-NodeA-7051:[]) [CLUSTER] ISPN100000: Node Test-NodeB-10318 joined the cluster 09:58:34,330 TRACE (Incoming-1,Test-NodeA-7051:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318], oldMembers=[Test-NodeA-7051], localAddress=Test-NodeA-7051, viewId=1, subgroupsMerged=null, mergeView=false} and result was 281479271677952 09:58:34,330 TRACE (Incoming-1,Test-NodeA-7051:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318], oldMembers=[Test-NodeA-7051], localAddress=Test-NodeA-7051, viewId=1, subgroupsMerged=null, mergeView=false} and result was 281479271677952 09:58:34,331 TRACE (Incoming-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: created sender window for Test-NodeA-7051 (conn-id=0) 09:58:34,331 TRACE (Incoming-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeA-7051: #1, conn_id=0, first) 09:58:34,331 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 09:58:34,331 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 09:58:34,331 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 09:58:34,331 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeA-7051: #1, conn_id=0, first) 09:58:34,331 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeA-7051#1 09:58:34,331 TRACE (Incoming-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=57 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 09:58:34,331 TRACE (Incoming-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: message Test-NodeA-7051::1 was added to queue (not yet server) 09:58:34,330 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,333 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [ClusterTopologyManagerImpl] Received new cluster view: 1, isCoordinator = true, old status = COORDINATOR 09:58:34,334 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: got all ACKs (1) from members for view [Test-NodeA-7051|1] 09:58:34,334 TRACE (ViewHandler,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: created sender window for Test-NodeB-10318 (conn-id=1) 09:58:34,334 TRACE (ViewHandler,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #1, conn_id=1, first) 09:58:34,334 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 09:58:34,343 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (132 bytes (660.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,343 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (135 bytes) 09:58:34,344 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=61 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 09:58:34,344 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #1, conn_id=1, first) 09:58:34,344 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: created receiver window for Test-NodeA-7051 at seqno=#1 for conn-id=1 09:58:34,344 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#1 09:58:34,344 DEBUG (testng-Test:[]) [NAKACK2] [Test-NodeB-10318 setDigest()] existing digest: [] new digest: Test-NodeA-7051: [0 (0)], Test-NodeB-10318: [0 (0)] resulting digest: Test-NodeA-7051: [0 (0)], Test-NodeB-10318: [0 (0)] 09:58:34,344 DEBUG (testng-Test:[]) [GMS] Test-NodeB-10318: installing view [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,345 TRACE (testng-Test:[]) [STABLE] Test-NodeB-10318: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1] 09:58:34,345 TRACE (testng-Test:[]) [TOA] Handle view [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,345 TRACE (testng-Test:[]) [MFC] new membership: [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,345 DEBUG (testng-Test:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,345 INFO (testng-Test:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|1] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,333 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [ClusterTopologyManagerImpl] Updating cluster members for all the caches. New list is [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,346 TRACE (testng-Test:[]) [NAKACK2] Test-NodeB-10318: flushing become_server_queue (1 elements) 09:58:34,354 TRACE (Incoming-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#1 09:58:34,355 TRACE (Incoming-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#1-1 (1 messages) 09:58:34,346 TRACE (testng-Test:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #2, conn_id=0) 09:58:34,372 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 09:58:34,372 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:34,372 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87210] on Test-NodeB-10318 09:58:34,372 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #2, conn_id=1) 09:58:34,372 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87210, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,372 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (82 bytes (410.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,372 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (85 bytes) 09:58:34,373 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 09:58:34,373 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,373 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (70 bytes) 09:58:34,373 INFO (testng-Test:[]) [JGroupsTransport] ISPN000079: Channel ISPN local address is Test-NodeB-10318, physical addresses are [127.0.0.1:7901] 09:58:34,373 TRACE (testng-Test:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,390 TRACE (OOB-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87210, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,390 TRACE (OOB-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #2, conn_id=1) 09:58:34,390 TRACE (OOB-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#2 09:58:34,390 TRACE (OOB-1,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87210 09:58:34,390 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 09:58:34,392 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #2, conn_id=0) 09:58:34,392 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#2 09:58:34,392 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,390 TRACE (OOB-1,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=Test-NodeA-7051] 09:58:34,397 TRACE (OOB-1,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,392 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [ClusterTopologyManagerImpl] Received new cluster view: 1, isCoordinator = false, old status = INITIALIZING 09:58:34,404 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #2) 09:58:34,392 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeB-10318, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=24000 09:58:34,404 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=2, ts=1, TP: [cluster_name=ISPN] 09:58:34,392 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: got all ACKs (1) from joiners for view [Test-NodeA-7051|1] 09:58:34,404 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,407 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:34,407 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeB-10318, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:34,408 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87214] on Test-NodeA-7051 09:58:34,408 TRACE (testng-Test:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #3, conn_id=0) 09:58:34,408 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87214, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 09:58:34,404 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,464 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=2, ts=1, TP: [cluster_name=ISPN] 09:58:34,464 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #2, conn-id=0, ts=1) 09:58:34,463 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (82 bytes (410.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,405 TRACE (ViewHandler,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1] 09:58:34,467 DEBUG (ViewHandler,Test-NodeA-7051:[]) [STABLE] resuming message garbage collection 09:58:34,467 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (85 bytes) 09:58:34,485 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87214, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 09:58:34,485 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #3, conn_id=0) 09:58:34,485 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#3 09:58:34,485 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87214 09:58:34,485 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=Test-NodeB-10318] 09:58:34,512 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,512 TRACE (remote-thread-Test-NodeA-p23726-t1:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:34,512 TRACE (remote-thread-Test-NodeA-p23726-t1:[]) [RequestCorrelator] sending rsp for 87214 to Test-NodeB-10318 09:58:34,512 TRACE (remote-thread-Test-NodeA-p23726-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #3, conn_id=1) 09:58:34,512 TRACE (remote-thread-Test-NodeA-p23726-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87214, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,512 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,512 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (82 bytes) 09:58:34,534 TRACE (OOB-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87214, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,534 TRACE (OOB-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #3, conn_id=1) 09:58:34,534 TRACE (OOB-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#3 09:58:34,534 TRACE (OOB-1,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 09:58:34,535 TRACE (testng-Test:[]) [LocalTopologyManagerImpl] Starting LocalTopologyManager on Test-NodeB-10318 09:58:34,535 DEBUG (testng-Test:[]) [DefaultCacheManager] Started cache manager ISPN on Test-NodeB 09:58:34,535 TRACE (testng-Test:[DistInitialTransferListener]) [DefaultCacheManager] About to wire and start cache DistInitialTransferListener 09:58:34,535 TRACE (remote-thread-Test-NodeB-p23775-t1:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:34,535 TRACE (remote-thread-Test-NodeB-p23775-t1:[]) [RequestCorrelator] sending rsp for 87210 to Test-NodeA-7051 09:58:34,535 TRACE (remote-thread-Test-NodeB-p23775-t1:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #4, conn_id=0) 09:58:34,536 TRACE (remote-thread-Test-NodeB-p23775-t1:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87210, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 09:58:34,536 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,536 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:58:34,536 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87210, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 09:58:34,536 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #4, conn_id=0) 09:58:34,536 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#4 09:58:34,550 DEBUG (testng-Test:[DistInitialTransferListener]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:58:34,550 DEBUG (testng-Test:[DistInitialTransferListener]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:34,550 DEBUG (testng-Test:[DistInitialTransferListener]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@4d227774 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@3ba6bc7a >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@7a94c57a >> org.infinispan.statetransfer.StateTransferInterceptor@12e72587 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@4c206978 >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@42eb49ea >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@1e88fbd8 >> org.infinispan.interceptors.impl.CallInterceptor@35682e93 09:58:34,551 TRACE (testng-Test:[DistInitialTransferListener]) [TransactionFactory] Setting factory enum to NODLD_NORECOVERY_XA 09:58:34,551 DEBUG (testng-Test:[DistInitialTransferListener]) [JmxUtil] Object name infinispan-76f50f3b-964a-4563-9a5f-91007505b8da:type=Cache,name="DistInitialTransferListener(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 09:58:34,551 TRACE (testng-Test:[DistInitialTransferListener]) [DistributionManagerImpl] starting distribution manager on Test-NodeB-10318 09:58:34,551 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Starting StateTransferManager of cache DistInitialTransferListener on node Test-NodeB-10318 09:58:34,536 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 09:58:34,560 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [ClusterCacheStatus] Cluster members updated for cache DistInitialTransferListener, no abrupt leavers detected: cache members = [Test-NodeA-7051, Test-NodeB-10318]. Existing members = [Test-NodeA-7051] 09:58:34,560 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [PreferAvailabilityStrategy] Cache DistInitialTransferListener did not lose any members, skipping rebalance 09:58:34,560 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,551 DEBUG (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Node Test-NodeB-10318 joining cache DistInitialTransferListener 09:58:34,565 TRACE (testng-Test:[DistInitialTransferListener]) [SemaphoreCompletionService] Moving task to background, available permits 1 09:58:34,566 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeB-10318, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=d46dbf65-fa9f-4bbf-888e-e28306c26dc0, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1}, mode=SYNCHRONOUS, timeout=240000 09:58:34,566 TRACE (testng-Test:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeB-10318, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=d46dbf65-fa9f-4bbf-888e-e28306c26dc0, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:34,568 TRACE (testng-Test:[DistInitialTransferListener]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87232] on Test-NodeA-7051 09:58:34,568 TRACE (testng-Test:[DistInitialTransferListener]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #5, conn_id=0) 09:58:34,568 TRACE (testng-Test:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87232, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 09:58:34,570 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (186 bytes (930.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,570 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (189 bytes) 09:58:34,570 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=112 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87232, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 09:58:34,570 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #5, conn_id=0) 09:58:34,570 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#5 09:58:34,570 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87232 09:58:34,570 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeB-10318, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=d46dbf65-fa9f-4bbf-888e-e28306c26dc0, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} [sender=Test-NodeB-10318] 09:58:34,570 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [ClusterCacheStatus] Added joiner Test-NodeB-10318 to cache DistInitialTransferListener with persistent uuid d46dbf65-fa9f-4bbf-888e-e28306c26dc0: members = [Test-NodeA-7051, Test-NodeB-10318], joiners = [Test-NodeB-10318] 09:58:34,570 DEBUG (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [ClusterCacheStatus] Queueing rebalance for cache DistInitialTransferListener with members [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,572 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [ClusterCacheStatus] Rebalancing consistent hash for cache DistInitialTransferListener, members are [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,570 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,573 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [ClusterCacheStatus] Updating cache DistInitialTransferListener topology for rebalance: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,579 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]}, members = [Test-NodeA-7051, Test-NodeB-10318], joiners = [Test-NodeB-10318] 09:58:34,579 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 09:58:34,579 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [CacheTopology] Pending consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:34,580 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Initialized rebalance confirmation collector 2@DistInitialTransferListener, initial list is [Test-NodeA-7051, Test-NodeB-10318] 09:58:34,580 INFO (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [CLUSTER] ISPN000310: Starting cluster-wide rebalance for cache DistInitialTransferListener, topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,580 INFO (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener][Scope=Test-NodeA-7051]ISPN100002: Started local rebalance 09:58:34,580 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1}, mode=ASYNCHRONOUS, timeout=240000 09:58:34,580 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} 09:58:34,580 TRACE (transport-thread-Test-NodeA-p23728-t5:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,580 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,580 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [JGroupsTransport] Waiting on view 1 being accepted 09:58:34,580 DEBUG (transport-thread-Test-NodeA-p23728-t6:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,580 DEBUG (transport-thread-Test-NodeA-p23728-t6:[]) [LocalTopologyManagerImpl] Starting local rebalance for cache DistInitialTransferListener, topology = CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,581 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 09:58:34,580 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} to single recipient Test-NodeB-10318 with response mode GET_NONE 09:58:34,591 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #4, conn_id=1) 09:58:34,600 TRACE (remote-thread-Test-NodeA-p23726-t2:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,600 TRACE (remote-thread-Test-NodeA-p23726-t2:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]}, stableTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]}}} for command CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeB-10318, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=d46dbf65-fa9f-4bbf-888e-e28306c26dc0, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} 09:58:34,601 TRACE (remote-thread-Test-NodeA-p23726-t2:[]) [RequestCorrelator] sending rsp for 87232 to Test-NodeB-10318 09:58:34,601 TRACE (remote-thread-Test-NodeA-p23726-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #5, conn_id=1) 09:58:34,601 TRACE (remote-thread-Test-NodeA-p23726-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87232, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,600 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [CacheTopology] Pending consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:34,600 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (5452 bytes (27260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,612 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (5455 bytes) 09:58:34,613 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (4486 bytes (22430.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,613 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (4489 bytes) 09:58:34,614 TRACE (OOB-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=5381 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,614 TRACE (OOB-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #4, conn_id=1) 09:58:34,614 TRACE (OOB-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#4 09:58:34,614 TRACE (OOB-1,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:34,614 TRACE (OOB-1,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} [sender=Test-NodeA-7051] 09:58:34,616 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 256+0, Test-NodeB-10318: 0+256]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} on cache DistInitialTransferListener 09:58:34,616 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = true, isMember = true, topology = CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 256+0, Test-NodeB-10318: 0+256]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,616 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateConsumerImpl] Start keeping track of keys for rebalance 09:58:34,624 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:34,624 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:34,624 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 09:58:34,624 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateTransferLockImpl] Signalling topology 2 is installed 09:58:34,647 TRACE (OOB-1,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,648 TRACE (remote-thread-Test-NodeB-p23775-t2:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 0 09:58:34,658 TRACE (OOB-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4412 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87232, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,660 TRACE (OOB-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #5, conn_id=1) 09:58:34,660 TRACE (OOB-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#5 09:58:34,660 TRACE (OOB-2,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]}, stableTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]}}} , received=true, suspected=false 09:58:34,660 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] Waiting on view 1 being accepted 09:58:34,660 DEBUG (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,661 TRACE (testng-Test:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 09:58:34,661 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} on cache DistInitialTransferListener 09:58:34,661 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = false, topology = CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,661 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferLockImpl] Signalling topology 1 is installed 09:58:34,670 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:34,670 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [] 09:58:34,670 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 2, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]} 09:58:34,670 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateTransferLockImpl] Signalling transaction data received for topology 2 09:58:34,670 DEBUG (transport-thread-Test-NodeA-p23728-t6:[]) [StateConsumerImpl] Finished receiving of segments for cache DistInitialTransferListener for topology 2. 09:58:34,670 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:34,670 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:34,670 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:34,670 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [LocalTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeA-7051, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} 09:58:34,671 DEBUG (transport-thread-Test-NodeA-p23728-t1:[DistInitialTransferListener]) [CLUSTER] ISPN000328: Finished local rebalance for cache DistInitialTransferListener on node Test-NodeA-7051, topology id = 2 09:58:34,671 INFO (transport-thread-Test-NodeA-p23728-t1:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener][Scope=Test-NodeA-7051]ISPN100003: Finished local rebalance 09:58:34,671 TRACE (transport-thread-Test-NodeA-p23728-t1:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Rebalance confirmation collector 2@DistInitialTransferListener received confirmation for Test-NodeA-7051, remaining list is [Test-NodeB-10318] 09:58:34,671 DEBUG (transport-thread-Test-NodeA-p23728-t6:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:34,671 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,674 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Requesting cluster listeners of cache DistInitialTransferListener from node Test-NodeA-7051 09:58:34,678 TRACE (testng-Test:[DistInitialTransferListener]) [RpcManagerImpl] Test-NodeB-10318 invoking StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:34,678 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=GET_CACHE_LISTENERS, topologyId=1, segments=null}, mode=SYNCHRONOUS, timeout=240000 09:58:34,678 TRACE (testng-Test:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:34,678 TRACE (testng-Test:[DistInitialTransferListener]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87247] on Test-NodeA-7051 09:58:34,678 TRACE (testng-Test:[DistInitialTransferListener]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #6, conn_id=0) 09:58:34,678 TRACE (testng-Test:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87247, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 09:58:34,679 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (114 bytes (570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,679 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (117 bytes) 09:58:34,679 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=40 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87247, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 09:58:34,679 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #6, conn_id=0) 09:58:34,679 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#6 09:58:34,681 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87247 09:58:34,681 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} [sender=Test-NodeB-10318] 09:58:34,686 TRACE (remote-thread-Test-NodeA-p23726-t3:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} 09:58:34,695 TRACE (remote-thread-Test-NodeA-p23726-t3:[DistInitialTransferListener]) [CacheNotifierImpl] Request received to get cluster listeners currently registered 09:58:34,695 TRACE (remote-thread-Test-NodeA-p23726-t3:[DistInitialTransferListener]) [CacheNotifierImpl] Cluster listeners found [] 09:58:34,695 TRACE (remote-thread-Test-NodeA-p23726-t3:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} 09:58:34,695 TRACE (remote-thread-Test-NodeA-p23726-t3:[]) [RequestCorrelator] sending rsp for 87247 to Test-NodeB-10318 09:58:34,695 TRACE (remote-thread-Test-NodeA-p23726-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #6, conn_id=1) 09:58:34,695 TRACE (remote-thread-Test-NodeA-p23726-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87247, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,696 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (82 bytes (410.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,696 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (85 bytes) 09:58:34,696 TRACE (OOB-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87247, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,696 TRACE (OOB-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #6, conn_id=1) 09:58:34,696 TRACE (OOB-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#6 09:58:34,696 TRACE (OOB-2,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 09:58:34,696 TRACE (OOB-2,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} is {Test-NodeA-7051=SuccessfulResponse{responseValue=[]} } 09:58:34,686 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,686 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #5) 09:58:34,696 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: [] 09:58:34,697 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 09:58:34,697 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferLockImpl] Signalling transaction data received for topology 1 09:58:34,697 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=1, TP: [cluster_name=ISPN] 09:58:34,703 TRACE (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,706 TRACE (testng-Test:[DistInitialTransferListener]) [SemaphoreCompletionService] Background task finished, available permits 1 09:58:34,706 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] StateTransferManager of cache DistInitialTransferListener on node Test-NodeB-10318 received initial topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd]} 09:58:34,706 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=Test-NodeB-10318, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1}, mode=SYNCHRONOUS, timeout=240000 09:58:34,706 TRACE (testng-Test:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=Test-NodeB-10318, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:34,706 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,706 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,712 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:34,712 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=1, TP: [cluster_name=ISPN] 09:58:34,712 TRACE (testng-Test:[DistInitialTransferListener]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87253] on Test-NodeA-7051 09:58:34,713 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [JGroupsTransport] Waiting on view 1 being accepted 09:58:34,719 DEBUG (transport-thread-Test-NodeB-p23777-t2:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,713 TRACE (testng-Test:[DistInitialTransferListener]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #7, conn_id=0) 09:58:34,713 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #5, conn-id=1, ts=1) 09:58:34,727 TRACE (testng-Test:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87253, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 09:58:34,727 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (113 bytes (565.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,727 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (116 bytes) 09:58:34,719 DEBUG (transport-thread-Test-NodeB-p23777-t2:[]) [LocalTopologyManagerImpl] Starting local rebalance for cache DistInitialTransferListener, topology = CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,727 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 09:58:34,727 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [CacheTopology] Pending consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:34,727 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 256+0, Test-NodeB-10318: 0+256]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} on cache DistInitialTransferListener 09:58:34,730 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateTransferManagerImpl] This is the first topology 2 in which the local node is a member 09:58:34,730 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = true, isMember = true, topology = CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 256+0, Test-NodeB-10318: 0+256]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Start keeping track of keys for rebalance 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateTransferLockImpl] Signalling topology 2 is installed 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [] 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; removed segments: [] 09:58:34,731 DEBUG (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Adding transfer from Test-NodeA-7051 for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Finished adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener 09:58:34,727 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=39 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87253, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 09:58:34,731 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #7, conn_id=0) 09:58:34,731 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#7 09:58:34,731 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87253 09:58:34,731 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 2, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]} 09:58:34,731 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,734 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [InboundTransferTask] Requesting segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener from node Test-NodeA-7051 09:58:34,734 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 09:58:34,734 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 09:58:34,735 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} to addresses [Test-NodeA-7051] with response mode GET_ALL 09:58:34,736 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [RequestCorrelator] Test-NodeB-10318: invoking multicast RPC [req-id=87256] 09:58:34,736 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #8, conn_id=0) 09:58:34,736 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87256, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 09:58:34,736 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (1416 bytes (7080.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,736 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (1419 bytes) 09:58:34,734 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateTransferLockImpl] Signalling transaction data received for topology 2 09:58:34,739 DEBUG (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:34,739 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,739 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=Test-NodeB-10318] 09:58:34,736 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=1342 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87256, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 09:58:34,744 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #8, conn_id=0) 09:58:34,744 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#8 09:58:34,744 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87256 09:58:34,744 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} [sender=Test-NodeB-10318] 09:58:34,753 TRACE (remote-thread-Test-NodeA-p23726-t4:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:34,755 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,755 TRACE (remote-thread-Test-NodeA-p23726-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} 09:58:34,757 TRACE (remote-thread-Test-NodeA-p23726-t5:[DistInitialTransferListener]) [StateProviderImpl] Starting outbound transfer of segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] to node Test-NodeB-10318 with topology id 2 for cache DistInitialTransferListener 09:58:34,757 TRACE (remote-thread-Test-NodeA-p23726-t5:[DistInitialTransferListener]) [StateProviderImpl] Adding outbound transfer of segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] to Test-NodeB-10318 09:58:34,758 TRACE (remote-thread-Test-NodeA-p23726-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} 09:58:34,761 TRACE (remote-thread-Test-NodeA-p23726-t4:[]) [RequestCorrelator] sending rsp for 87253 to Test-NodeB-10318 09:58:34,761 TRACE (remote-thread-Test-NodeA-p23726-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #7, conn_id=1) 09:58:34,761 TRACE (remote-thread-Test-NodeA-p23726-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87253, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,761 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,761 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (82 bytes) 09:58:34,762 TRACE (OOB-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87253, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,762 TRACE (OOB-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #7, conn_id=1) 09:58:34,753 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,762 TRACE (OOB-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#7 09:58:34,758 TRACE (remote-thread-Test-NodeA-p23726-t5:[]) [RequestCorrelator] sending rsp for 87256 to Test-NodeB-10318 09:58:34,764 TRACE (remote-thread-Test-NodeA-p23726-t5:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #8, conn_id=1) 09:58:34,764 TRACE (remote-thread-Test-NodeA-p23726-t5:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87256, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,764 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,758 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [OutboundTransferTask] Sending last chunk containing 0 cache entries from segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener to node Test-NodeB-10318 09:58:34,765 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=2} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:34,766 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=2}, mode=SYNCHRONOUS, timeout=240000 09:58:34,766 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=2} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:34,767 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87264] on Test-NodeB-10318 09:58:34,767 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #9, conn_id=1) 09:58:34,767 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87264, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,764 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (82 bytes) 09:58:34,768 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (2183 bytes (10915.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,768 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (2186 bytes) 09:58:34,768 TRACE (OOB-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87256, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,768 TRACE (OOB-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #8, conn_id=1) 09:58:34,768 TRACE (OOB-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#8 09:58:34,768 TRACE (OOB-1,Test-NodeB-10318:[]) [JGroupsTransport] Responses: Responses{ Test-NodeA-7051: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=true} , received=true, suspected=false} 09:58:34,768 TRACE (OOB-1,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} is {Test-NodeA-7051=SuccessfulResponse{responseValue=true} } 09:58:34,768 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [InboundTransferTask] Successfully requested segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener from node Test-NodeA-7051 09:58:34,768 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Waiting for inbound transfer to finish: InboundTransferTask{segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], finishedSegments=[], unfinishedSegments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], source=Test-NodeA-7051, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=false, topologyId=2, timeout=240000, cacheName=DistInitialTransferListener} 09:58:34,769 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [SemaphoreCompletionService] Moving task to background, available permits 0 09:58:34,769 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits -1 09:58:34,773 TRACE (OOB-2,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 09:58:34,768 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2109 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87264, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,774 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #9, conn_id=1) 09:58:34,774 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#9 09:58:34,774 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87264 09:58:34,774 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=2} [sender=Test-NodeA-7051] 09:58:34,774 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 2 09:58:34,775 TRACE (remote-thread-Test-NodeB-p23775-t3:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=2} 09:58:34,775 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,780 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Before applying the received state the data container of cache DistInitialTransferListener has 0 keys 09:58:34,780 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 0 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,780 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 0 of cache DistInitialTransferListener 09:58:34,781 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 1 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 1 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 6 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 2 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 6 of cache DistInitialTransferListener 09:58:34,781 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 2 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 7 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 7 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 9 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 9 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 10 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 10 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 11 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 11 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 12 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 12 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 13 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 13 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 14 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 14 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 15 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 15 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 16 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 16 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 17 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 17 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 18 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 18 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 19 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 19 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 20 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 20 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 21 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 21 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 22 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 22 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 23 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 23 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 24 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 24 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 25 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 25 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 26 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 26 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 27 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 27 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 28 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 28 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 29 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 29 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 30 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 30 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 31 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 31 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 32 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 32 of cache DistInitialTransferListener 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 33 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 33 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 34 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 34 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 35 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 35 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 36 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 36 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 37 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 37 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 38 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 38 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 39 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 39 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 40 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 40 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 41 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 41 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 42 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 42 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 43 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 43 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 44 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 44 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 45 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 45 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 46 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 46 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 47 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 47 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 48 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 48 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 49 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 49 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 50 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 50 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 51 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 51 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 52 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 52 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 53 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 53 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 54 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 54 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 55 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 55 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 56 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 56 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 57 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 57 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 58 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 58 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 59 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 59 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 60 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 60 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 61 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 61 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 62 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 62 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 63 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 63 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 64 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 64 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 65 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 65 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 66 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 66 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 67 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 67 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 68 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 68 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 69 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 69 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 70 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 70 of cache DistInitialTransferListener 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 71 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 71 of cache DistInitialTransferListener 09:58:34,773 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Waiting for initial state transfer to finish for cache DistInitialTransferListener on Test-NodeB-10318 09:58:34,782 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 3 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 4 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,782 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 72 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 8 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,781 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 5 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,786 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 5 of cache DistInitialTransferListener 09:58:34,786 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 8 of cache DistInitialTransferListener 09:58:34,785 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 72 of cache DistInitialTransferListener 09:58:34,785 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 4 of cache DistInitialTransferListener 09:58:34,789 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 73 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,785 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 3 of cache DistInitialTransferListener 09:58:34,789 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 74 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,789 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 74 of cache DistInitialTransferListener 09:58:34,789 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 73 of cache DistInitialTransferListener 09:58:34,789 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 75 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,789 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 75 of cache DistInitialTransferListener 09:58:34,790 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 76 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,790 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 78 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,790 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 78 of cache DistInitialTransferListener 09:58:34,790 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 77 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,790 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 77 of cache DistInitialTransferListener 09:58:34,790 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 79 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,790 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 76 of cache DistInitialTransferListener 09:58:34,792 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 79 of cache DistInitialTransferListener 09:58:34,790 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 80 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,792 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 80 of cache DistInitialTransferListener 09:58:34,796 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 83 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,796 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 84 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,796 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 81 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,796 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 82 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,796 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 85 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,797 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 85 of cache DistInitialTransferListener 09:58:34,797 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 86 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,797 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 86 of cache DistInitialTransferListener 09:58:34,797 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 87 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,812 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 82 of cache DistInitialTransferListener 09:58:34,797 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 81 of cache DistInitialTransferListener 09:58:34,797 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 84 of cache DistInitialTransferListener 09:58:34,797 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 83 of cache DistInitialTransferListener 09:58:34,804 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 87 of cache DistInitialTransferListener 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 92 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 92 of cache DistInitialTransferListener 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 93 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 93 of cache DistInitialTransferListener 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 94 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 94 of cache DistInitialTransferListener 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 95 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 95 of cache DistInitialTransferListener 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 96 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 96 of cache DistInitialTransferListener 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 97 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 91 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 91 of cache DistInitialTransferListener 09:58:34,813 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 90 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 90 of cache DistInitialTransferListener 09:58:34,813 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 88 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 97 of cache DistInitialTransferListener 09:58:34,818 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 100 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,813 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 89 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,819 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 99 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,819 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 99 of cache DistInitialTransferListener 09:58:34,818 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 100 of cache DistInitialTransferListener 09:58:34,818 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 98 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,820 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 88 of cache DistInitialTransferListener 09:58:34,819 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 98 of cache DistInitialTransferListener 09:58:34,819 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 89 of cache DistInitialTransferListener 09:58:34,823 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 103 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,823 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 103 of cache DistInitialTransferListener 09:58:34,823 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 105 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 104 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 104 of cache DistInitialTransferListener 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 101 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 101 of cache DistInitialTransferListener 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 102 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,823 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 105 of cache DistInitialTransferListener 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 102 of cache DistInitialTransferListener 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 107 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 107 of cache DistInitialTransferListener 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 108 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 108 of cache DistInitialTransferListener 09:58:34,823 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 109 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,823 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 106 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,829 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 106 of cache DistInitialTransferListener 09:58:34,829 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 109 of cache DistInitialTransferListener 09:58:34,837 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 113 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,837 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 113 of cache DistInitialTransferListener 09:58:34,837 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 110 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,837 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 110 of cache DistInitialTransferListener 09:58:34,837 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 112 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,837 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 111 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,837 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 114 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,840 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 114 of cache DistInitialTransferListener 09:58:34,840 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 111 of cache DistInitialTransferListener 09:58:34,840 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 117 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,840 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 117 of cache DistInitialTransferListener 09:58:34,840 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 119 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,840 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 118 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,840 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 118 of cache DistInitialTransferListener 09:58:34,840 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 115 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,840 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 115 of cache DistInitialTransferListener 09:58:34,840 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 116 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,840 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 116 of cache DistInitialTransferListener 09:58:34,840 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 112 of cache DistInitialTransferListener 09:58:34,840 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 119 of cache DistInitialTransferListener 09:58:34,843 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 124 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,843 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 124 of cache DistInitialTransferListener 09:58:34,843 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 125 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,843 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 125 of cache DistInitialTransferListener 09:58:34,843 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 120 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,843 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 121 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,843 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 121 of cache DistInitialTransferListener 09:58:34,843 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 123 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,843 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 122 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,845 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 122 of cache DistInitialTransferListener 09:58:34,843 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 120 of cache DistInitialTransferListener 09:58:34,843 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 126 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,846 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 126 of cache DistInitialTransferListener 09:58:34,846 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 130 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,846 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 130 of cache DistInitialTransferListener 09:58:34,846 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 128 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,846 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 128 of cache DistInitialTransferListener 09:58:34,846 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 129 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,846 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 129 of cache DistInitialTransferListener 09:58:34,846 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 131 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,847 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 131 of cache DistInitialTransferListener 09:58:34,847 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 134 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,847 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 134 of cache DistInitialTransferListener 09:58:34,847 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 135 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 135 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 136 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 136 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 137 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 137 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 138 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 138 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 139 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 139 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 140 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 140 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 141 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 141 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 142 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 142 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 143 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 143 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 144 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 144 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 145 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 145 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 146 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 146 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 147 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 147 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 148 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 148 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 149 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 149 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 150 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 150 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 151 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 151 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 152 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 152 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 153 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 153 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 154 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 154 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 155 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 155 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 156 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 156 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 157 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 157 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 158 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 158 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 159 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 159 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 160 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 160 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 161 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 161 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 162 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 162 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 163 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 163 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 164 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 164 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 165 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 165 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 166 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 166 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 167 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 167 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 168 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 168 of cache DistInitialTransferListener 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 169 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,848 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 169 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 170 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 170 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 171 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 171 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 172 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 172 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 173 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 173 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 174 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 174 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 175 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 175 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 176 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 176 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 177 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 177 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 178 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 178 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 179 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 179 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 180 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 180 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 181 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 181 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 182 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 182 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 183 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 183 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 184 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 184 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 185 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 185 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 186 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 186 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 187 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 187 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 188 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 188 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 189 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 189 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 190 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 190 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 191 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 191 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 192 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 192 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 193 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 193 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 194 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 194 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 195 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 195 of cache DistInitialTransferListener 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 196 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,849 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 196 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 197 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 197 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 198 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 198 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 199 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 199 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 200 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 200 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 201 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 201 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 202 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 202 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 203 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 203 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 204 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 204 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 205 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 205 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 206 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 206 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 207 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 207 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 208 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 208 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 209 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 209 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 210 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 210 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 211 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 211 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 212 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 212 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 213 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 213 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 214 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 214 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 215 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 215 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 216 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 216 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 217 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 217 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 218 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 218 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 219 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 219 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 220 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 220 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 221 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 221 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 222 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 222 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 223 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 223 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 224 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 224 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 225 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 225 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 226 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 226 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 227 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 227 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 228 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 228 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 229 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 229 of cache DistInitialTransferListener 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 230 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,850 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 230 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 231 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 231 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 232 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 232 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 233 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 233 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 234 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 234 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 235 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 235 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 236 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 236 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 237 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 237 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 238 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 238 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 239 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 239 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 240 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 240 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 241 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 241 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 242 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 242 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 243 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 243 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 244 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 244 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 245 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 245 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 246 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 246 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 247 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 247 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 248 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 248 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 249 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 249 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 250 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 250 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 251 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 251 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 252 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 252 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 253 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 253 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 254 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 254 of cache DistInitialTransferListener 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 255 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 255 of cache DistInitialTransferListener 09:58:34,851 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 132 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,851 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 132 of cache DistInitialTransferListener 09:58:34,852 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 133 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,852 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 133 of cache DistInitialTransferListener 09:58:34,852 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 123 of cache DistInitialTransferListener 09:58:34,847 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 127 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:34,853 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 127 of cache DistInitialTransferListener 09:58:34,854 DEBUG (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [InboundTransferTask] Finished receiving state for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener 09:58:34,855 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t3:[]) [SemaphoreCompletionService] Background task finished, executing cleanup task 09:58:34,855 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] After applying the received state the data container of cache DistInitialTransferListener has 0 keys 09:58:34,855 TRACE (remote-thread-Test-NodeB-p23775-t3:[DistInitialTransferListener]) [StateConsumerImpl] Segments not received yet for cache DistInitialTransferListener: {Test-NodeA-7051=[InboundTransferTask{segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], finishedSegments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], unfinishedSegments=[], source=Test-NodeA-7051, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=2, timeout=240000, cacheName=DistInitialTransferListener}]} 09:58:34,856 TRACE (remote-thread-Test-NodeB-p23775-t3:[]) [CommandAwareRpcDispatcher] About to send back response null for command StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=2} 09:58:34,856 TRACE (remote-thread-Test-NodeB-p23775-t3:[]) [RequestCorrelator] sending rsp for 87264 to Test-NodeA-7051 09:58:34,856 TRACE (remote-thread-Test-NodeB-p23775-t3:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #9, conn_id=0) 09:58:34,856 TRACE (remote-thread-Test-NodeB-p23775-t3:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87264, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 09:58:34,855 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,860 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Removing inbound transfers for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] from source Test-NodeA-7051 for cache DistInitialTransferListener 09:58:34,860 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Inbound transfer finished: InboundTransferTask{segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], finishedSegments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], unfinishedSegments=[], source=Test-NodeA-7051, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=2, timeout=240000, cacheName=DistInitialTransferListener} 09:58:34,861 DEBUG (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Finished receiving of segments for cache DistInitialTransferListener for topology 2. 09:58:34,861 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:34,861 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:34,861 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:34,861 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeB-10318, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1}, mode=ASYNCHRONOUS, timeout=0 09:58:34,861 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeB-10318, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} to single recipient Test-NodeA-7051 with response mode GET_NONE 09:58:34,861 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #10, conn_id=0) 09:58:34,861 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 09:58:34,861 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,859 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,862 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:34,864 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (139 bytes (695.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,864 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (142 bytes) 09:58:34,868 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87264, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 09:58:34,868 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #9, conn_id=0) 09:58:34,868 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#9 09:58:34,868 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:34,868 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=2} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:34,869 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=68 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 09:58:34,869 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [OutboundTransferTask] Outbound transfer of segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache DistInitialTransferListener to node Test-NodeB-10318 is complete 09:58:34,870 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateProviderImpl] Removing completed outbound transfer of segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] to Test-NodeB-10318 for cache DistInitialTransferListener 09:58:34,870 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #10, conn_id=0) 09:58:34,876 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#10 09:58:34,876 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:34,880 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeB-10318, joinInfo=null, topologyId=2, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} [sender=Test-NodeB-10318] 09:58:34,885 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,885 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] ISPN000328: Finished local rebalance for cache DistInitialTransferListener on node Test-NodeB-10318, topology id = 2 09:58:34,885 INFO (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener][Scope=Test-NodeB-10318]ISPN100003: Finished local rebalance 09:58:34,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Rebalance confirmation collector 2@DistInitialTransferListener received confirmation for Test-NodeB-10318, remaining list is [] 09:58:34,885 INFO (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] ISPN000336: Finished cluster-wide rebalance for cache DistInitialTransferListener, topology id = 2 09:58:34,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]}, members = [Test-NodeA-7051, Test-NodeB-10318], joiners = [] 09:58:34,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:34,885 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache DistInitialTransferListener, topology = CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]}, availability mode = AVAILABLE 09:58:34,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1}, mode=ASYNCHRONOUS, timeout=240000 09:58:34,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} to single recipient Test-NodeB-10318 with response mode GET_NONE 09:58:34,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #10, conn_id=1) 09:58:34,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,885 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (3362 bytes (16810.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,885 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (3365 bytes) 09:58:34,888 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} 09:58:34,888 TRACE (transport-thread-Test-NodeA-p23728-t3:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,888 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [JGroupsTransport] Waiting on view 1 being accepted 09:58:34,889 DEBUG (transport-thread-Test-NodeA-p23728-t3:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [CacheTopology] Current consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} on cache DistInitialTransferListener 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = true, topology = CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateTransferLockImpl] Signalling topology 3 is installed 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [] 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 2, startRebalance = false, pending CH = null 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:34,889 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:34,890 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:34,890 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [LocalStreamManagerImpl] Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]} with new topology 3 and was pre false 09:58:34,890 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [LocalStreamManagerImpl] No change listeners present! 09:58:34,890 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateConsumerImpl] Unlock State Transfer in Progress for topology ID 3 09:58:34,890 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [StateTransferLockImpl] Signalling transaction data received for topology 3 09:58:34,890 DEBUG (transport-thread-Test-NodeA-p23728-t3:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:34,890 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,890 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=3291 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,890 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #10, conn_id=1) 09:58:34,890 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#10 09:58:34,890 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:34,895 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} [sender=Test-NodeA-7051] 09:58:34,885 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterTopologyManagerImpl] Updating cluster-wide stable topology for cache DistInitialTransferListener, topology = CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,903 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} 09:58:34,903 TRACE (transport-thread-Test-NodeA-p23728-t5:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,902 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,903 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,905 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [LocalTopologyManagerImpl] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,905 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,903 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1}, mode=ASYNCHRONOUS, timeout=240000 09:58:34,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} to single recipient Test-NodeB-10318 with response mode GET_NONE 09:58:34,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #11, conn_id=1) 09:58:34,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,907 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (3361 bytes (16805.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,908 TRACE (remote-thread-Test-NodeB-p23775-t4:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,906 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #10) 09:58:34,908 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=10, ts=2, TP: [cluster_name=ISPN] 09:58:34,908 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,907 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (3364 bytes) 09:58:34,911 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=3290 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 09:58:34,908 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [JGroupsTransport] Waiting on view 1 being accepted 09:58:34,923 DEBUG (transport-thread-Test-NodeB-p23777-t3:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,911 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #11, conn_id=1) 09:58:34,911 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:34,924 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:34,924 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#11 09:58:34,927 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, ts=2, TP: [cluster_name=ISPN] 09:58:34,927 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #10, conn-id=0, ts=2) 09:58:34,924 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [CacheTopology] Current consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:34,930 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} on cache DistInitialTransferListener 09:58:34,930 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = true, topology = CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,930 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateTransferLockImpl] Signalling topology 3 is installed 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [] 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 2, startRebalance = false, pending CH = null 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [LocalStreamManagerImpl] Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[Test-NodeA-7051: 256+0]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]} with new topology 3 and was pre false 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [LocalStreamManagerImpl] No change listeners present! 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateConsumerImpl] Unlock State Transfer in Progress for topology ID 3 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateTransferLockImpl] Signalling transaction data received for topology 3 09:58:34,931 DEBUG (transport-thread-Test-NodeB-p23777-t3:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [StateTransferManagerImpl] Initial state transfer complete for cache DistInitialTransferListener on node Test-NodeB-10318 09:58:34,931 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,927 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:34,931 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], throwable=null, viewId=1} [sender=Test-NodeA-7051] 09:58:34,931 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:34,931 TRACE (remote-thread-Test-NodeB-p23775-t5:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,932 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,932 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [LocalTopologyManagerImpl] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:34,932 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:34,931 DEBUG (testng-Test:[DistInitialTransferListener]) [CacheImpl] Started cache DistInitialTransferListener on Test-NodeB-10318 09:58:34,936 TRACE (testng-Test:[DistInitialTransferListener]) [DefaultCacheManager] Closing latch for cache DistInitialTransferListener 09:58:34,937 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: ModuleLifecycle 09:58:34,937 DEBUG (testng-Test:[]) [ServiceFinder] Loading service impl: CoreTestMetadataFileFinder 09:58:34,940 DEBUG (testng-Test:[]) [ServiceFinder] Loading service impl: TestModuleCommandExtensions 09:58:34,941 DEBUG (testng-Test:[]) [ModuleProperties] Loading module command extension SPI class: org.infinispan.remoting.rpc.TestModuleCommandExtensions@3e20dc93 09:58:34,947 INFO (testng-Test:[]) [JGroupsTransport] ISPN000078: Starting JGroups channel ISPN 09:58:34,949 DEBUG (testng-Test:[]) [Configurator] set property TCP_NIO2.diagnostics_addr to default value /224.0.75.75 09:58:34,950 TRACE (testng-Test:[]) [NAKACK2] null: set max_xmit_req_size from 0 to 247600 09:58:34,950 TRACE (testng-Test:[]) [UNICAST3] null: set max_xmit_req_size from 0 to 247600 09:58:34,951 TRACE (testng-Test:[]) [MessageDispatcher] setting local_addr (null) to Test-NodeC-52778 09:58:34,951 TRACE (testng-Test:[]) [STABLE] Test-NodeC-52778: stable task started 09:58:34,951 TRACE (testng-Test:[]) [TEST_PING] Discovery.stopped=false 09:58:34,951 DEBUG (testng-Test:[]) [GMS] address=Test-NodeC-52778, cluster=ISPN, physical address=127.0.0.1:7902 09:58:34,951 TRACE (testng-Test:[]) [TEST_PING] Added discovery for Test-NodeC-52778. Registered discoveries: {Test-NodeA-7051=TEST_PING@Test-NodeA-7051, Test-NodeB-10318=TEST_PING@Test-NodeB-10318, Test-NodeC-52778=TEST_PING@Test-NodeC-52778} 09:58:34,951 TRACE (testng-Test:[]) [TEST_PING] Map Test-NodeA-7051 with physical address 127.0.0.1:7900 in TEST_PING@Test-NodeC-52778 09:58:34,951 TRACE (testng-Test:[]) [TEST_PING] Map Test-NodeC-52778 with physical address 127.0.0.1:7902 in TEST_PING@Test-NodeA-7051 09:58:34,951 TRACE (testng-Test:[]) [TEST_PING] Returning ping rsp: Test-NodeA-7051, name=Test-NodeA-7051, addr=127.0.0.1:7900, coord 09:58:34,952 TRACE (testng-Test:[]) [TEST_PING] Map Test-NodeB-10318 with physical address 127.0.0.1:7901 in TEST_PING@Test-NodeC-52778 09:58:34,952 TRACE (testng-Test:[]) [TEST_PING] Map Test-NodeC-52778 with physical address 127.0.0.1:7902 in TEST_PING@Test-NodeB-10318 09:58:34,952 TRACE (testng-Test:[]) [TEST_PING] Returning ping rsp: Test-NodeB-10318, name=Test-NodeB-10318, addr=127.0.0.1:7901, server 09:58:34,952 TRACE (testng-Test:[]) [TEST_PING] Skipping sending discovery to self 09:58:34,952 TRACE (testng-Test:[]) [GMS] Test-NodeC-52778: discovery took 1 ms, members: 2 rsps (1 coords) [done] 09:58:34,952 DEBUG (testng-Test:[]) [GMS] Test-NodeC-52778: sending JOIN(Test-NodeC-52778) to Test-NodeA-7051 09:58:34,952 TRACE (testng-Test:[]) [UNICAST3] Test-NodeC-52778: created sender window for Test-NodeA-7051 (conn-id=0) 09:58:34,952 TRACE (testng-Test:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #1, conn_id=0, first) 09:58:34,952 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are GMS: GmsHeader[JOIN_REQ]: mbr=Test-NodeC-52778, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 09:58:34,952 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:34,952 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (86 bytes) 09:58:34,952 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] 127.0.0.1:7902: connecting to 127.0.0.1:7900 09:58:34,953 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_REQ]: mbr=Test-NodeC-52778, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 09:58:34,953 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #1, conn_id=0, first) 09:58:34,953 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: created receiver window for Test-NodeC-52778 at seqno=#1 for conn-id=0 09:58:34,953 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#1 09:58:34,953 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: joiners=[Test-NodeC-52778], suspected=[], leaving=[], new view: [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,960 DEBUG (ViewHandler,Test-NodeA-7051:[]) [STABLE] suspending message garbage collection 09:58:34,960 DEBUG (ViewHandler,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: resume task started, max_suspend_time=33000 09:58:34,963 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: mcasting view [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] (3 mbrs) 09:58:34,963 TRACE (ViewHandler,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#2 09:58:34,963 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 09:58:34,963 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes] 09:58:34,963 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (112 bytes (560.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:34,963 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (115 bytes) 09:58:34,963 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (115 bytes) 09:58:34,963 TRACE (Incoming-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 09:58:34,963 TRACE (Incoming-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#2 09:58:34,963 TRACE (Incoming-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#2-2 (1 messages) 09:58:34,981 TRACE (Incoming-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 09:58:34,981 TRACE (Incoming-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: message Test-NodeA-7051::2 was added to queue (not yet server) 09:58:34,963 TRACE (Incoming-1,Test-NodeB-10318:[]) [GMS] Test-NodeB-10318: received delta view [Test-NodeA-7051|2], ref-view=[Test-NodeA-7051|1], joined=[Test-NodeC-52778] 09:58:34,963 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 09:58:34,984 TRACE (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: received Test-NodeA-7051#2 09:58:34,983 DEBUG (Incoming-1,Test-NodeB-10318:[]) [GMS] Test-NodeB-10318: installing view [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,984 TRACE (Incoming-1,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:34,984 TRACE (Incoming-1,Test-NodeB-10318:[]) [TOA] Handle view [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,984 TRACE (Incoming-1,Test-NodeB-10318:[]) [MFC] new membership: [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,984 DEBUG (Incoming-1,Test-NodeB-10318:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,984 DEBUG (Incoming-1,Test-NodeB-10318:[]) [JGroupsTransport] Joined: [Test-NodeC-52778], Left: [] 09:58:34,985 INFO (Incoming-1,Test-NodeB-10318:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,984 TRACE (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: delivering Test-NodeA-7051#2-2 (1 messages) 09:58:34,985 TRACE (Incoming-1,Test-NodeB-10318:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,985 TRACE (Incoming-1,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: received delta view [Test-NodeA-7051|2], ref-view=[Test-NodeA-7051|1], joined=[Test-NodeC-52778] 09:58:34,985 DEBUG (Incoming-1,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: installing view [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,985 TRACE (Incoming-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:34,985 TRACE (Incoming-1,Test-NodeA-7051:[]) [TOA] Handle view [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,985 TRACE (Incoming-1,Test-NodeA-7051:[]) [MFC] new membership: [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,985 DEBUG (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,987 DEBUG (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] Joined: [Test-NodeC-52778], Left: [] 09:58:34,987 INFO (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:34,987 TRACE (Incoming-1,Test-NodeA-7051:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:34,997 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,997 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:34,997 INFO (Incoming-1,Test-NodeB-10318:[]) [CLUSTER] ISPN100000: Node Test-NodeC-52778 joined the cluster 09:58:35,000 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [ClusterTopologyManagerImpl] Received new cluster view: 2, isCoordinator = false, old status = REGULAR_MEMBER 09:58:35,000 TRACE (Incoming-1,Test-NodeB-10318:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], oldMembers=[Test-NodeA-7051, Test-NodeB-10318], localAddress=Test-NodeB-10318, viewId=2, subgroupsMerged=null, mergeView=false} and result was 562958543355904 09:58:34,997 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [ClusterTopologyManagerImpl] Received new cluster view: 2, isCoordinator = true, old status = COORDINATOR 09:58:35,000 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [ClusterTopologyManagerImpl] Updating cluster members for all the caches. New list is [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,000 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 09:58:35,000 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to addresses null with response mode GET_ALL 09:58:35,000 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [RequestCorrelator] Test-NodeA-7051: invoking multicast RPC [req-id=87291] 09:58:35,000 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#3 09:58:35,000 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87291, rsp_expected=true, NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 09:58:35,000 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [MFC] Test-NodeA-7051 used 8 credits, 1999992 remaining 09:58:34,997 INFO (Incoming-1,Test-NodeA-7051:[]) [CLUSTER] ISPN100000: Node Test-NodeC-52778 joined the cluster 09:58:35,000 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (62 bytes (310.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:35,000 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (65 bytes) 09:58:35,000 TRACE (Incoming-1,Test-NodeA-7051:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], oldMembers=[Test-NodeA-7051, Test-NodeB-10318], localAddress=Test-NodeA-7051, viewId=2, subgroupsMerged=null, mergeView=false} and result was 562954248388608 09:58:35,000 TRACE (Incoming-1,Test-NodeA-7051:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], oldMembers=[Test-NodeA-7051, Test-NodeB-10318], localAddress=Test-NodeA-7051, viewId=2, subgroupsMerged=null, mergeView=false} and result was 562954248388608 09:58:35,000 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (65 bytes) 09:58:35,000 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87291, rsp_expected=true, NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 09:58:35,000 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#3 09:58:35,000 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#3 09:58:35,001 TRACE (OOB-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87291, rsp_expected=true, NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 09:58:35,001 TRACE (OOB-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: message Test-NodeA-7051::3 was added to queue (not yet server) 09:58:35,001 TRACE (Incoming-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeA-7051: #2, conn_id=0) 09:58:35,001 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 09:58:35,001 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 09:58:35,001 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 09:58:35,000 TRACE (Incoming-1,Test-NodeB-10318:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], oldMembers=[Test-NodeA-7051, Test-NodeB-10318], localAddress=Test-NodeB-10318, viewId=2, subgroupsMerged=null, mergeView=false} and result was 562958543355904 09:58:35,001 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeA-7051: #2, conn_id=0) 09:58:35,001 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeA-7051#2 09:58:35,002 TRACE (Incoming-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #11, conn_id=0) 09:58:35,000 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,002 TRACE (Incoming-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 09:58:35,002 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,004 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (70 bytes) 09:58:35,004 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 09:58:35,004 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #11, conn_id=0) 09:58:35,000 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87291 09:58:35,004 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=Test-NodeA-7051] 09:58:35,004 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#11 09:58:35,004 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: got all ACKs (2) from members for view [Test-NodeA-7051|2] 09:58:35,009 TRACE (ViewHandler,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: created sender window for Test-NodeC-52778 (conn-id=2) 09:58:35,010 TRACE (ViewHandler,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #1, conn_id=2, first) 09:58:35,013 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 09:58:35,013 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (152 bytes (760.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,013 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (155 bytes) 09:58:35,018 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:35,017 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,018 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87291 to Test-NodeA-7051 09:58:35,018 TRACE (OOB-3,Test-NodeB-10318:[]) [MFC] Test-NodeA-7051 used 8 credits, 1999992 remaining 09:58:35,018 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #12, conn_id=0) 09:58:35,019 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87291, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 09:58:35,019 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,019 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:58:35,019 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87291, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 09:58:35,019 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #12, conn_id=0) 09:58:35,019 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#12 09:58:35,021 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=81 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 09:58:35,023 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #1, conn_id=2, first) 09:58:35,023 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: created receiver window for Test-NodeA-7051 at seqno=#1 for conn-id=2 09:58:35,023 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#1 09:58:35,023 DEBUG (testng-Test:[]) [NAKACK2] [Test-NodeC-52778 setDigest()] existing digest: [] new digest: Test-NodeA-7051: [1 (1)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] resulting digest: Test-NodeA-7051: [1 (1)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:58:35,024 DEBUG (testng-Test:[]) [GMS] Test-NodeC-52778: installing view [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,024 TRACE (testng-Test:[]) [STABLE] Test-NodeC-52778: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:35,024 TRACE (testng-Test:[]) [TOA] Handle view [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,024 TRACE (testng-Test:[]) [MFC] new membership: [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,024 DEBUG (testng-Test:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,089 INFO (testng-Test:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|2] (3) [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,090 TRACE (testng-Test:[]) [NAKACK2] Test-NodeC-52778: flushing become_server_queue (2 elements) 09:58:35,090 TRACE (testng-Test:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #2, conn_id=0) 09:58:35,090 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 09:58:35,090 INFO (testng-Test:[]) [JGroupsTransport] ISPN000079: Channel ISPN local address is Test-NodeC-52778, physical addresses are [127.0.0.1:7902] 09:58:35,090 TRACE (OOB-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received Test-NodeA-7051#3 09:58:35,090 TRACE (OOB-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: delivering Test-NodeA-7051#3 09:58:35,090 TRACE (OOB-1,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87291 09:58:35,090 TRACE (testng-Test:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,090 TRACE (OOB-1,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=Test-NodeA-7051] 09:58:35,090 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeC-52778, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=24000 09:58:35,090 TRACE (transport-thread-Test-NodeC-p23889-t1:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,090 TRACE (OOB-1,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,090 TRACE (transport-thread-Test-NodeC-p23889-t1:[]) [ClusterTopologyManagerImpl] Received new cluster view: 2, isCoordinator = false, old status = INITIALIZING 09:58:35,092 TRACE (transport-thread-Test-NodeC-p23889-t1:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,090 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeC-52778, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:35,092 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87301] on Test-NodeA-7051 09:58:35,090 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,090 TRACE (Incoming-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received Test-NodeA-7051#2 09:58:35,093 TRACE (Incoming-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: delivering Test-NodeA-7051#2-2 (1 messages) 09:58:35,093 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (70 bytes) 09:58:35,092 TRACE (testng-Test:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #3, conn_id=0) 09:58:35,093 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87301, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 09:58:35,093 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 09:58:35,093 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #2, conn_id=0) 09:58:35,093 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#2 09:58:35,093 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (82 bytes (410.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,093 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (85 bytes) 09:58:35,093 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: got all ACKs (1) from joiners for view [Test-NodeA-7051|2] 09:58:35,093 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87301, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 09:58:35,092 TRACE (OOB-1,Test-NodeC-52778:[]) [MFC] Test-NodeA-7051 used 8 credits, 1999992 remaining 09:58:35,093 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #3, conn_id=0) 09:58:35,093 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#3 09:58:35,094 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87301 09:58:35,094 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=Test-NodeC-52778] 09:58:35,094 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:35,094 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,093 TRACE (ViewHandler,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:35,094 DEBUG (ViewHandler,Test-NodeA-7051:[]) [STABLE] resuming message garbage collection 09:58:35,094 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87301 to Test-NodeC-52778 09:58:35,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #2, conn_id=2) 09:58:35,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87301, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,095 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,096 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:58:35,096 TRACE (OOB-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87301, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,096 TRACE (OOB-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #2, conn_id=2) 09:58:35,096 TRACE (OOB-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#2 09:58:35,096 TRACE (OOB-1,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 09:58:35,096 TRACE (testng-Test:[]) [LocalTopologyManagerImpl] Starting LocalTopologyManager on Test-NodeC-52778 09:58:35,097 DEBUG (testng-Test:[]) [DefaultCacheManager] Started cache manager ISPN on Test-NodeC 09:58:35,097 TRACE (remote-thread-Test-NodeC-p23887-t1:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:35,098 TRACE (testng-Test:[DistInitialTransferListener]) [DefaultCacheManager] About to wire and start cache DistInitialTransferListener 09:58:35,177 DEBUG (testng-Test:[DistInitialTransferListener]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:58:35,177 DEBUG (testng-Test:[DistInitialTransferListener]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:35,177 DEBUG (testng-Test:[DistInitialTransferListener]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@64fa2d16 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@71c8c9b7 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@4ea7dc11 >> org.infinispan.statetransfer.StateTransferInterceptor@224fb067 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@17e8aba5 >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@20da4d9e >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@506d5ac0 >> org.infinispan.interceptors.impl.CallInterceptor@f7e0422 09:58:35,182 TRACE (testng-Test:[DistInitialTransferListener]) [TransactionFactory] Setting factory enum to NODLD_NORECOVERY_XA 09:58:35,182 DEBUG (testng-Test:[DistInitialTransferListener]) [JmxUtil] Object name infinispan-9e64174d-bd7a-418a-92c7-809288867edc:type=Cache,name="DistInitialTransferListener(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 09:58:35,182 TRACE (testng-Test:[DistInitialTransferListener]) [DistributionManagerImpl] starting distribution manager on Test-NodeC-52778 09:58:35,182 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Starting StateTransferManager of cache DistInitialTransferListener on node Test-NodeC-52778 09:58:35,183 TRACE (remote-thread-Test-NodeC-p23887-t1:[]) [RequestCorrelator] sending rsp for 87291 to Test-NodeA-7051 09:58:35,185 TRACE (remote-thread-Test-NodeC-p23887-t1:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #4, conn_id=0) 09:58:35,182 DEBUG (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Node Test-NodeC-52778 joining cache DistInitialTransferListener 09:58:35,185 TRACE (testng-Test:[DistInitialTransferListener]) [SemaphoreCompletionService] Moving task to background, available permits 1 09:58:35,185 TRACE (remote-thread-Test-NodeC-p23887-t1:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87291, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 09:58:35,186 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,186 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:58:35,186 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87291, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 09:58:35,186 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #4, conn_id=0) 09:58:35,186 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#4 09:58:35,186 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: Responses{ Test-NodeB-10318: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=true} , received=true, suspected=false Test-NodeC-52778: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=true} , received=true, suspected=false} 09:58:35,186 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [ClusterCacheStatus] Cluster members updated for cache DistInitialTransferListener, no abrupt leavers detected: cache members = [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778]. Existing members = [Test-NodeA-7051, Test-NodeB-10318] 09:58:35,186 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [PreferAvailabilityStrategy] Cache DistInitialTransferListener did not lose any members, skipping rebalance 09:58:35,185 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeC-52778, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=3b86e938-cae6-4329-b29b-08820b7af692, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=SYNCHRONOUS, timeout=240000 09:58:35,188 TRACE (testng-Test:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeC-52778, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=3b86e938-cae6-4329-b29b-08820b7af692, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:35,188 TRACE (testng-Test:[DistInitialTransferListener]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87306] on Test-NodeA-7051 09:58:35,188 TRACE (testng-Test:[DistInitialTransferListener]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #5, conn_id=0) 09:58:35,188 TRACE (testng-Test:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87306, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 09:58:35,188 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (186 bytes (930.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,188 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (189 bytes) 09:58:35,188 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=112 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87306, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 09:58:35,188 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #5, conn_id=0) 09:58:35,188 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#5 09:58:35,296 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #11) 09:58:35,186 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,296 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=11, conn_id=1, ts=2, TP: [cluster_name=ISPN] 09:58:35,305 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,305 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:35,306 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=11, conn_id=1, ts=2, TP: [cluster_name=ISPN] 09:58:35,306 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #11, conn-id=1, ts=2) 09:58:35,188 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87306 09:58:35,308 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeC-52778, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=3b86e938-cae6-4329-b29b-08820b7af692, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} [sender=Test-NodeC-52778] 09:58:35,309 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,309 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Added joiner Test-NodeC-52778 to cache DistInitialTransferListener with persistent uuid 3b86e938-cae6-4329-b29b-08820b7af692: members = [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], joiners = [Test-NodeC-52778] 09:58:35,310 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Queueing rebalance for cache DistInitialTransferListener with members [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,312 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Rebalancing consistent hash for cache DistInitialTransferListener, members are [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,316 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Updating cache DistInitialTransferListener topology for rebalance: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,318 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]}, members = [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], joiners = [Test-NodeC-52778] 09:58:35,318 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:35,318 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CacheTopology] Pending consistent hash's routing table: 0: 1 2, 1: 1 2, 2: 2 0, 3: 0 2, 4: 2 0, 5: 0 1, 6: 1 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 2 1, 11: 1 0, 12: 0 2, 13: 0 2, 14: 2 1, 15: 2 1, 16: 2 1, 17: 1 2, 18: 2 0, 19: 2 0, 20: 0 2, 21: 2 0, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 2, 30: 2 1, 31: 2 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 2, 39: 1 2, 40: 2 1, 41: 2 1, 42: 1 0, 43: 0 1, 44: 1 2, 45: 2 1, 46: 1 2, 47: 2 0, 48: 2 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 2, 60: 2 0, 61: 0 2, 62: 0 2, 63: 2 1, 64: 1 0, 65: 1 0, 66: 0 2, 67: 2 0, 68: 0 2, 69: 2 0, 70: 0 2, 71: 2 0, 72: 2 0, 73: 0 2, 74: 2 1, 75: 1 2, 76: 2 1, 77: 1 2, 78: 2 0, 79: 0 1, 80: 1 2, 81: 2 1, 82: 2 1, 83: 2 1, 84: 1 2, 85: 2 1, 86: 2 1, 87: 1 0, 88: 1 0, 89: 0 2, 90: 2 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 2 0, 95: 0 2, 96: 2 1, 97: 1 2, 98: 2 1, 99: 2 1, 100: 1 0, 101: 0 2, 102: 0 2, 103: 2 0, 104: 0 1, 105: 0 1, 106: 1 2, 107: 2 0, 108: 2 0, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 2, 113: 2 0, 114: 0 1, 115: 1 2, 116: 1 2, 117: 1 2, 118: 2 0, 119: 2 0, 120: 2 0, 121: 0 2, 122: 2 0, 123: 0 2, 124: 2 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 2, 129: 2 0, 130: 2 0, 131: 2 0, 132: 2 0, 133: 2 0, 134: 0 2, 135: 2 1, 136: 1 2, 137: 1 2, 138: 1 2, 139: 2 0, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 2, 146: 0 2, 147: 2 1, 148: 2 1, 149: 1 2, 150: 1 2, 151: 2 1, 152: 1 2, 153: 2 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 1 2, 158: 2 1, 159: 2 1, 160: 1 0, 161: 1 0, 162: 0 2, 163: 0 2, 164: 2 1, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 2, 180: 2 1, 181: 2 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 2, 194: 1 2, 195: 2 0, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 2, 200: 0 2, 201: 2 1, 202: 1 2, 203: 2 1, 204: 1 2, 205: 2 1, 206: 1 2, 207: 1 2, 208: 1 2, 209: 1 2, 210: 2 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 2, 219: 2 0, 220: 0 2, 221: 0 2, 222: 2 0, 223: 0 2, 224: 2 0, 225: 0 1, 226: 1 2, 227: 2 1, 228: 2 1, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 0, 238: 0 2, 239: 2 1, 240: 2 1, 241: 2 1, 242: 1 2, 243: 1 2, 244: 1 2, 245: 2 0, 246: 0 1, 247: 1 2, 248: 1 2, 249: 2 0, 250: 0 1, 251: 1 2, 252: 1 2, 253: 2 1, 254: 1 0, 255: 0 1 09:58:35,319 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Initialized rebalance confirmation collector 4@DistInitialTransferListener, initial list is [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] 09:58:35,334 INFO (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] ISPN000310: Starting cluster-wide rebalance for cache DistInitialTransferListener, topology CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,335 INFO (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener][Scope=Test-NodeA-7051]ISPN100002: Started local rebalance 09:58:35,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 09:58:35,339 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} 09:58:35,340 TRACE (transport-thread-Test-NodeA-p23728-t2:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,340 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} to addresses null with response mode GET_NONE 09:58:35,340 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,344 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:58:35,344 DEBUG (transport-thread-Test-NodeA-p23728-t2:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,344 DEBUG (transport-thread-Test-NodeA-p23728-t2:[]) [LocalTopologyManagerImpl] Starting local rebalance for cache DistInitialTransferListener, topology = CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,346 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [CacheTopology] Current consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:35,346 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [CacheTopology] Pending consistent hash's routing table: 0: 1 2, 1: 1 2, 2: 2 0, 3: 0 2, 4: 2 0, 5: 0 1, 6: 1 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 2 1, 11: 1 0, 12: 0 2, 13: 0 2, 14: 2 1, 15: 2 1, 16: 2 1, 17: 1 2, 18: 2 0, 19: 2 0, 20: 0 2, 21: 2 0, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 2, 30: 2 1, 31: 2 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 2, 39: 1 2, 40: 2 1, 41: 2 1, 42: 1 0, 43: 0 1, 44: 1 2, 45: 2 1, 46: 1 2, 47: 2 0, 48: 2 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 2, 60: 2 0, 61: 0 2, 62: 0 2, 63: 2 1, 64: 1 0, 65: 1 0, 66: 0 2, 67: 2 0, 68: 0 2, 69: 2 0, 70: 0 2, 71: 2 0, 72: 2 0, 73: 0 2, 74: 2 1, 75: 1 2, 76: 2 1, 77: 1 2, 78: 2 0, 79: 0 1, 80: 1 2, 81: 2 1, 82: 2 1, 83: 2 1, 84: 1 2, 85: 2 1, 86: 2 1, 87: 1 0, 88: 1 0, 89: 0 2, 90: 2 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 2 0, 95: 0 2, 96: 2 1, 97: 1 2, 98: 2 1, 99: 2 1, 100: 1 0, 101: 0 2, 102: 0 2, 103: 2 0, 104: 0 1, 105: 0 1, 106: 1 2, 107: 2 0, 108: 2 0, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 2, 113: 2 0, 114: 0 1, 115: 1 2, 116: 1 2, 117: 1 2, 118: 2 0, 119: 2 0, 120: 2 0, 121: 0 2, 122: 2 0, 123: 0 2, 124: 2 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 2, 129: 2 0, 130: 2 0, 131: 2 0, 132: 2 0, 133: 2 0, 134: 0 2, 135: 2 1, 136: 1 2, 137: 1 2, 138: 1 2, 139: 2 0, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 2, 146: 0 2, 147: 2 1, 148: 2 1, 149: 1 2, 150: 1 2, 151: 2 1, 152: 1 2, 153: 2 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 1 2, 158: 2 1, 159: 2 1, 160: 1 0, 161: 1 0, 162: 0 2, 163: 0 2, 164: 2 1, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 2, 180: 2 1, 181: 2 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 2, 194: 1 2, 195: 2 0, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 2, 200: 0 2, 201: 2 1, 202: 1 2, 203: 2 1, 204: 1 2, 205: 2 1, 206: 1 2, 207: 1 2, 208: 1 2, 209: 1 2, 210: 2 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 2, 219: 2 0, 220: 0 2, 221: 0 2, 222: 2 0, 223: 0 2, 224: 2 0, 225: 0 1, 226: 1 2, 227: 2 1, 228: 2 1, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 0, 238: 0 2, 239: 2 1, 240: 2 1, 241: 2 1, 242: 1 2, 243: 1 2, 244: 1 2, 245: 2 0, 246: 0 1, 247: 1 2, 248: 1 2, 249: 2 0, 250: 0 1, 251: 1 2, 252: 1 2, 253: 2 1, 254: 1 0, 255: 0 1 09:58:35,346 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122, Test-NodeC-52778: 0+165]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:58:35,346 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = true, isMember = true, topology = CacheTopology{id=4, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122, Test-NodeC-52778: 0+165]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,344 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#4 09:58:35,346 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateConsumerImpl] Start keeping track of keys for rebalance 09:58:35,346 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,346 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 09:58:35,348 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,348 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (6542 bytes (32710.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:35,348 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 09:58:35,348 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [MFC] Test-NodeA-7051 used 6491 credits, 1993501 remaining 09:58:35,349 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateTransferLockImpl] Signalling topology 4 is installed 09:58:35,349 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (6545 bytes) 09:58:35,349 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (6545 bytes) 09:58:35,349 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:35,350 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [] 09:58:35,350 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=6491 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 09:58:35,350 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#4 09:58:35,350 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 4, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} 09:58:35,349 TRACE (OOB-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (3 headers), size=6491 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 09:58:35,350 TRACE (OOB-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received Test-NodeA-7051#4 09:58:35,350 TRACE (OOB-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: delivering Test-NodeA-7051#4 09:58:35,350 TRACE (OOB-1,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:35,351 TRACE (OOB-1,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:58:35,351 TRACE (OOB-1,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,351 TRACE (OOB-1,Test-NodeC-52778:[]) [MFC] Test-NodeA-7051 used 6491 credits, 1993501 remaining 09:58:35,351 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]}, stableTopology=CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]}}} for command CacheTopologyControlCommand{cache=DistInitialTransferListener, type=JOIN, sender=Test-NodeC-52778, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, distributed=true, persistentUUID=3b86e938-cae6-4329-b29b-08820b7af692, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} 09:58:35,351 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87306 to Test-NodeC-52778 09:58:35,351 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #3, conn_id=2) 09:58:35,351 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87306, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,350 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateTransferLockImpl] Signalling transaction data received for topology 4 09:58:35,351 DEBUG (transport-thread-Test-NodeA-p23728-t2:[]) [StateConsumerImpl] Finished receiving of segments for cache DistInitialTransferListener for topology 4. 09:58:35,350 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#4 09:58:35,480 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:35,480 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #2) 09:58:35,480 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:58:35,480 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,479 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #12) 09:58:35,481 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=12, ts=3, TP: [cluster_name=ISPN] 09:58:35,481 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #5) 09:58:35,351 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:35,481 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,351 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (6485 bytes (32425.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,351 TRACE (remote-thread-Test-NodeC-p23887-t2:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 0 09:58:35,481 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (6488 bytes) 09:58:35,482 TRACE (OOB-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=6411 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87306, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,482 TRACE (OOB-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #3, conn_id=2) 09:58:35,481 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,482 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [LocalTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeA-7051, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} 09:58:35,482 DEBUG (transport-thread-Test-NodeA-p23728-t3:[DistInitialTransferListener]) [CLUSTER] ISPN000328: Finished local rebalance for cache DistInitialTransferListener on node Test-NodeA-7051, topology id = 4 09:58:35,481 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=5, ts=4, TP: [cluster_name=ISPN] 09:58:35,480 TRACE (OOB-3,Test-NodeB-10318:[]) [MFC] Test-NodeA-7051 used 6491 credits, 1993501 remaining 09:58:35,480 TRACE (remote-thread-Test-NodeB-p23775-t6:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,483 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,480 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=2, conn_id=2, ts=1, TP: [cluster_name=ISPN] 09:58:35,483 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,483 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:35,483 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:58:35,484 DEBUG (transport-thread-Test-NodeB-p23777-t6:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,482 INFO (transport-thread-Test-NodeA-p23728-t3:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener][Scope=Test-NodeA-7051]ISPN100003: Finished local rebalance 09:58:35,482 DEBUG (transport-thread-Test-NodeA-p23728-t2:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:35,482 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:35,490 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:35,491 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,491 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:35,491 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, ts=4, TP: [cluster_name=ISPN] 09:58:35,491 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #5, conn-id=0, ts=4) 09:58:35,491 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=12, ts=3, TP: [cluster_name=ISPN] 09:58:35,491 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #12, conn-id=0, ts=3) 09:58:35,490 TRACE (OOB-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#3 09:58:35,492 TRACE (OOB-1,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]}, stableTopology=CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]}}} , received=true, suspected=false 09:58:35,492 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] Waiting on view 2 being accepted 09:58:35,492 DEBUG (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:35,492 TRACE (testng-Test:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:35,492 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} on cache DistInitialTransferListener 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = false, topology = CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferLockImpl] Signalling topology 3 is installed 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Requesting cluster listeners of cache DistInitialTransferListener from node Test-NodeA-7051 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [RpcManagerImpl] Test-NodeC-52778 invoking StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=GET_CACHE_LISTENERS, topologyId=3, segments=null}, mode=SYNCHRONOUS, timeout=240000 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87314] on Test-NodeA-7051 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #6, conn_id=0) 09:58:35,493 TRACE (testng-Test:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87314, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 09:58:35,490 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,490 TRACE (transport-thread-Test-NodeA-p23728-t3:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Rebalance confirmation collector 4@DistInitialTransferListener received confirmation for Test-NodeA-7051, remaining list is [Test-NodeB-10318, Test-NodeC-52778] 09:58:35,484 DEBUG (transport-thread-Test-NodeB-p23777-t6:[]) [LocalTopologyManagerImpl] Starting local rebalance for cache DistInitialTransferListener, topology = CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,484 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=2, conn_id=2, ts=1, TP: [cluster_name=ISPN] 09:58:35,494 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [CacheTopology] Current consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:35,493 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (114 bytes (570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,496 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [CacheTopology] Pending consistent hash's routing table: 0: 1 2, 1: 1 2, 2: 2 0, 3: 0 2, 4: 2 0, 5: 0 1, 6: 1 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 2 1, 11: 1 0, 12: 0 2, 13: 0 2, 14: 2 1, 15: 2 1, 16: 2 1, 17: 1 2, 18: 2 0, 19: 2 0, 20: 0 2, 21: 2 0, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 2, 30: 2 1, 31: 2 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 2, 39: 1 2, 40: 2 1, 41: 2 1, 42: 1 0, 43: 0 1, 44: 1 2, 45: 2 1, 46: 1 2, 47: 2 0, 48: 2 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 2, 60: 2 0, 61: 0 2, 62: 0 2, 63: 2 1, 64: 1 0, 65: 1 0, 66: 0 2, 67: 2 0, 68: 0 2, 69: 2 0, 70: 0 2, 71: 2 0, 72: 2 0, 73: 0 2, 74: 2 1, 75: 1 2, 76: 2 1, 77: 1 2, 78: 2 0, 79: 0 1, 80: 1 2, 81: 2 1, 82: 2 1, 83: 2 1, 84: 1 2, 85: 2 1, 86: 2 1, 87: 1 0, 88: 1 0, 89: 0 2, 90: 2 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 2 0, 95: 0 2, 96: 2 1, 97: 1 2, 98: 2 1, 99: 2 1, 100: 1 0, 101: 0 2, 102: 0 2, 103: 2 0, 104: 0 1, 105: 0 1, 106: 1 2, 107: 2 0, 108: 2 0, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 2, 113: 2 0, 114: 0 1, 115: 1 2, 116: 1 2, 117: 1 2, 118: 2 0, 119: 2 0, 120: 2 0, 121: 0 2, 122: 2 0, 123: 0 2, 124: 2 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 2, 129: 2 0, 130: 2 0, 131: 2 0, 132: 2 0, 133: 2 0, 134: 0 2, 135: 2 1, 136: 1 2, 137: 1 2, 138: 1 2, 139: 2 0, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 2, 146: 0 2, 147: 2 1, 148: 2 1, 149: 1 2, 150: 1 2, 151: 2 1, 152: 1 2, 153: 2 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 1 2, 158: 2 1, 159: 2 1, 160: 1 0, 161: 1 0, 162: 0 2, 163: 0 2, 164: 2 1, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 2, 180: 2 1, 181: 2 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 2, 194: 1 2, 195: 2 0, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 2, 200: 0 2, 201: 2 1, 202: 1 2, 203: 2 1, 204: 1 2, 205: 2 1, 206: 1 2, 207: 1 2, 208: 1 2, 209: 1 2, 210: 2 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 2, 219: 2 0, 220: 0 2, 221: 0 2, 222: 2 0, 223: 0 2, 224: 2 0, 225: 0 1, 226: 1 2, 227: 2 1, 228: 2 1, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 0, 238: 0 2, 239: 2 1, 240: 2 1, 241: 2 1, 242: 1 2, 243: 1 2, 244: 1 2, 245: 2 0, 246: 0 1, 247: 1 2, 248: 1 2, 249: 2 0, 250: 0 1, 251: 1 2, 252: 1 2, 253: 2 1, 254: 1 0, 255: 0 1 09:58:35,495 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #2, conn-id=2, ts=1) 09:58:35,497 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122, Test-NodeC-52778: 0+165]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:58:35,496 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (117 bytes) 09:58:35,498 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=40 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87314, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 09:58:35,497 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = true, isMember = true, topology = CacheTopology{id=4, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122, Test-NodeC-52778: 0+165]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,499 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateConsumerImpl] Start keeping track of keys for rebalance 09:58:35,499 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,502 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #6, conn_id=0) 09:58:35,502 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#6 09:58:35,503 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,503 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 09:58:35,503 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateTransferLockImpl] Signalling topology 4 is installed 09:58:35,503 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:35,503 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [] 09:58:35,503 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 4, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} 09:58:35,503 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateTransferLockImpl] Signalling transaction data received for topology 4 09:58:35,503 DEBUG (transport-thread-Test-NodeB-p23777-t6:[]) [StateConsumerImpl] Finished receiving of segments for cache DistInitialTransferListener for topology 4. 09:58:35,503 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:35,504 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87314 09:58:35,504 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,506 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} [sender=Test-NodeC-52778] 09:58:35,506 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} 09:58:35,505 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,506 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeB-10318, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=0 09:58:35,506 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeB-10318, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient Test-NodeA-7051 with response mode GET_NONE 09:58:35,506 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #13, conn_id=0) 09:58:35,506 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,507 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CacheNotifierImpl] Request received to get cluster listeners currently registered 09:58:35,507 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 09:58:35,508 DEBUG (transport-thread-Test-NodeB-p23777-t6:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:35,508 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,508 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (139 bytes (695.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,507 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CacheNotifierImpl] Cluster listeners found [] 09:58:35,508 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (142 bytes) 09:58:35,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} 09:58:35,511 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=68 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 09:58:35,512 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #13, conn_id=0) 09:58:35,512 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#13 09:58:35,512 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:35,511 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87314 to Test-NodeC-52778 09:58:35,512 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeB-10318, joinInfo=null, topologyId=4, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} [sender=Test-NodeB-10318] 09:58:35,513 DEBUG (remote-thread-Test-NodeA-p23726-t5:[DistInitialTransferListener]) [CLUSTER] ISPN000328: Finished local rebalance for cache DistInitialTransferListener on node Test-NodeB-10318, topology id = 4 09:58:35,513 INFO (remote-thread-Test-NodeA-p23726-t5:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener][Scope=Test-NodeB-10318]ISPN100003: Finished local rebalance 09:58:35,513 TRACE (remote-thread-Test-NodeA-p23726-t5:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Rebalance confirmation collector 4@DistInitialTransferListener received confirmation for Test-NodeB-10318, remaining list is [Test-NodeC-52778] 09:58:35,513 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,513 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #4, conn_id=2) 09:58:35,514 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87314, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,517 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (82 bytes (410.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,517 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (85 bytes) 09:58:35,519 TRACE (OOB-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87314, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,520 TRACE (OOB-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #4, conn_id=2) 09:58:35,520 TRACE (OOB-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#4 09:58:35,520 TRACE (OOB-1,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 09:58:35,520 TRACE (OOB-1,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} is {Test-NodeA-7051=SuccessfulResponse{responseValue=[]} } 09:58:35,520 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: [] 09:58:35,520 TRACE (testng-Test:[DistInitialTransferListener]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 09:58:35,520 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferLockImpl] Signalling transaction data received for topology 3 09:58:35,520 TRACE (testng-Test:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:35,520 TRACE (testng-Test:[DistInitialTransferListener]) [SemaphoreCompletionService] Background task finished, available permits 1 09:58:35,520 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,520 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] StateTransferManager of cache DistInitialTransferListener on node Test-NodeC-52778 received initial topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0]} 09:58:35,520 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=Test-NodeC-52778, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=SYNCHRONOUS, timeout=240000 09:58:35,520 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:58:35,522 DEBUG (transport-thread-Test-NodeC-p23889-t2:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,522 TRACE (testng-Test:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=Test-NodeC-52778, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:35,522 TRACE (testng-Test:[DistInitialTransferListener]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87320] on Test-NodeA-7051 09:58:35,522 TRACE (testng-Test:[DistInitialTransferListener]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #7, conn_id=0) 09:58:35,522 DEBUG (transport-thread-Test-NodeC-p23889-t2:[]) [LocalTopologyManagerImpl] Starting local rebalance for cache DistInitialTransferListener, topology = CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,526 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [CacheTopology] Current consistent hash's routing table: 0: 1 0, 1: 1 0, 2: 0 1, 3: 0 1, 4: 1 0, 5: 0 1, 6: 1 0, 7: 0 1, 8: 1 0, 9: 0 1, 10: 0 1, 11: 1 0, 12: 0 1, 13: 0 1, 14: 0 1, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 0 1, 21: 0 1, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 0, 30: 1 0, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 1 0, 40: 0 1, 41: 0 1, 42: 1 0, 43: 0 1, 44: 1 0, 45: 0 1, 46: 1 0, 47: 0 1, 48: 1 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 0, 60: 0 1, 61: 0 1, 62: 0 1, 63: 0 1, 64: 1 0, 65: 1 0, 66: 0 1, 67: 1 0, 68: 0 1, 69: 1 0, 70: 0 1, 71: 0 1, 72: 0 1, 73: 0 1, 74: 1 0, 75: 1 0, 76: 0 1, 77: 1 0, 78: 1 0, 79: 0 1, 80: 1 0, 81: 1 0, 82: 0 1, 83: 1 0, 84: 1 0, 85: 1 0, 86: 0 1, 87: 1 0, 88: 1 0, 89: 0 1, 90: 1 0, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 0 1, 102: 0 1, 103: 1 0, 104: 0 1, 105: 0 1, 106: 1 0, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 0 1, 114: 0 1, 115: 1 0, 116: 1 0, 117: 1 0, 118: 0 1, 119: 1 0, 120: 0 1, 121: 0 1, 122: 1 0, 123: 0 1, 124: 1 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 0 1, 134: 0 1, 135: 0 1, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 1, 146: 0 1, 147: 1 0, 148: 1 0, 149: 1 0, 150: 1 0, 151: 1 0, 152: 1 0, 153: 1 0, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 1 0, 161: 1 0, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 0 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 0, 194: 1 0, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 1, 200: 0 1, 201: 0 1, 202: 1 0, 203: 0 1, 204: 1 0, 205: 1 0, 206: 1 0, 207: 1 0, 208: 1 0, 209: 1 0, 210: 0 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 1, 219: 1 0, 220: 0 1, 221: 0 1, 222: 1 0, 223: 0 1, 224: 1 0, 225: 0 1, 226: 1 0, 227: 0 1, 228: 0 1, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 0 1, 237: 1 0, 238: 0 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 1 0, 243: 1 0, 244: 1 0, 245: 1 0, 246: 0 1, 247: 1 0, 248: 1 0, 249: 0 1, 250: 0 1, 251: 1 0, 252: 1 0, 253: 0 1, 254: 1 0, 255: 0 1 09:58:35,526 TRACE (testng-Test:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87320, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 09:58:35,527 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [CacheTopology] Pending consistent hash's routing table: 0: 1 2, 1: 1 2, 2: 2 0, 3: 0 2, 4: 2 0, 5: 0 1, 6: 1 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 2 1, 11: 1 0, 12: 0 2, 13: 0 2, 14: 2 1, 15: 2 1, 16: 2 1, 17: 1 2, 18: 2 0, 19: 2 0, 20: 0 2, 21: 2 0, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 2, 30: 2 1, 31: 2 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 2, 39: 1 2, 40: 2 1, 41: 2 1, 42: 1 0, 43: 0 1, 44: 1 2, 45: 2 1, 46: 1 2, 47: 2 0, 48: 2 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 2, 60: 2 0, 61: 0 2, 62: 0 2, 63: 2 1, 64: 1 0, 65: 1 0, 66: 0 2, 67: 2 0, 68: 0 2, 69: 2 0, 70: 0 2, 71: 2 0, 72: 2 0, 73: 0 2, 74: 2 1, 75: 1 2, 76: 2 1, 77: 1 2, 78: 2 0, 79: 0 1, 80: 1 2, 81: 2 1, 82: 2 1, 83: 2 1, 84: 1 2, 85: 2 1, 86: 2 1, 87: 1 0, 88: 1 0, 89: 0 2, 90: 2 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 2 0, 95: 0 2, 96: 2 1, 97: 1 2, 98: 2 1, 99: 2 1, 100: 1 0, 101: 0 2, 102: 0 2, 103: 2 0, 104: 0 1, 105: 0 1, 106: 1 2, 107: 2 0, 108: 2 0, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 2, 113: 2 0, 114: 0 1, 115: 1 2, 116: 1 2, 117: 1 2, 118: 2 0, 119: 2 0, 120: 2 0, 121: 0 2, 122: 2 0, 123: 0 2, 124: 2 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 2, 129: 2 0, 130: 2 0, 131: 2 0, 132: 2 0, 133: 2 0, 134: 0 2, 135: 2 1, 136: 1 2, 137: 1 2, 138: 1 2, 139: 2 0, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 2, 146: 0 2, 147: 2 1, 148: 2 1, 149: 1 2, 150: 1 2, 151: 2 1, 152: 1 2, 153: 2 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 1 2, 158: 2 1, 159: 2 1, 160: 1 0, 161: 1 0, 162: 0 2, 163: 0 2, 164: 2 1, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 2, 180: 2 1, 181: 2 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 2, 194: 1 2, 195: 2 0, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 2, 200: 0 2, 201: 2 1, 202: 1 2, 203: 2 1, 204: 1 2, 205: 2 1, 206: 1 2, 207: 1 2, 208: 1 2, 209: 1 2, 210: 2 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 2, 219: 2 0, 220: 0 2, 221: 0 2, 222: 2 0, 223: 0 2, 224: 2 0, 225: 0 1, 226: 1 2, 227: 2 1, 228: 2 1, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 0, 238: 0 2, 239: 2 1, 240: 2 1, 241: 2 1, 242: 1 2, 243: 1 2, 244: 1 2, 245: 2 0, 246: 0 1, 247: 1 2, 248: 1 2, 249: 2 0, 250: 0 1, 251: 1 2, 252: 1 2, 253: 2 1, 254: 1 0, 255: 0 1 09:58:35,527 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122, Test-NodeC-52778: 0+165]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:58:35,527 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateTransferManagerImpl] This is the first topology 4 in which the local node is a member 09:58:35,527 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = true, isMember = true, topology = CacheTopology{id=4, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122, Test-NodeC-52778: 0+165]}, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,528 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] Start keeping track of keys for rebalance 09:58:35,528 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,528 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,529 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 09:58:35,529 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateTransferLockImpl] Signalling topology 4 is installed 09:58:35,529 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253]; old segments: [] 09:58:35,529 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253]; removed segments: [] 09:58:35,529 DEBUG (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] Adding inbound state transfer for segments [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253] of cache DistInitialTransferListener 09:58:35,529 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] Adding transfer from Test-NodeA-7051 for segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] 09:58:35,529 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,529 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] Adding transfer from Test-NodeB-10318 for segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] 09:58:35,529 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,527 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (113 bytes (565.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,529 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (116 bytes) 09:58:35,529 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [InboundTransferTask] Requesting segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] of cache DistInitialTransferListener from node Test-NodeA-7051 09:58:35,530 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 0 09:58:35,530 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] Finished adding inbound state transfer for segments [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253] of cache DistInitialTransferListener 09:58:35,530 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253]} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 09:58:35,531 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 09:58:35,531 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253]} to addresses [Test-NodeA-7051] with response mode GET_ALL 09:58:35,531 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [RequestCorrelator] Test-NodeC-52778: invoking multicast RPC [req-id=87323] 09:58:35,531 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #8, conn_id=0) 09:58:35,531 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87323, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 09:58:35,532 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=39 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87320, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 09:58:35,532 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #7, conn_id=0) 09:58:35,533 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 4, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} 09:58:35,532 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#7 09:58:35,532 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (486 bytes (2430.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,534 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (489 bytes) 09:58:35,534 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87320 09:58:35,535 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=Test-NodeC-52778] 09:58:35,535 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=DistInitialTransferListener, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:58:35,533 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [StateTransferLockImpl] Signalling transaction data received for topology 4 09:58:35,536 DEBUG (transport-thread-Test-NodeC-p23889-t2:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:35,536 TRACE (transport-thread-Test-NodeC-p23889-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,535 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87320 to Test-NodeC-52778 09:58:35,535 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,535 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=412 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87323, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 09:58:35,540 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #8, conn_id=0) 09:58:35,541 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#8 09:58:35,540 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #5, conn_id=2) 09:58:35,541 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87320, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,541 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87323 09:58:35,549 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253]} [sender=Test-NodeC-52778] 09:58:35,549 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253]} 09:58:35,549 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [StateProviderImpl] Starting outbound transfer of segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] to node Test-NodeC-52778 with topology id 4 for cache DistInitialTransferListener 09:58:35,549 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,549 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [StateProviderImpl] Adding outbound transfer of segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] to Test-NodeC-52778 09:58:35,549 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253]} 09:58:35,549 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87323 to Test-NodeC-52778 09:58:35,549 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #6, conn_id=2) 09:58:35,549 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87323, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,548 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,556 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [OutboundTransferTask] Sending last chunk containing 0 cache entries from segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] of cache DistInitialTransferListener to node Test-NodeC-52778 09:58:35,556 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=4} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:35,556 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=4}, mode=SYNCHRONOUS, timeout=240000 09:58:35,556 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=4} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:35,556 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87330] on Test-NodeC-52778 09:58:35,556 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #7, conn_id=2) 09:58:35,556 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87330, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,560 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:58:35,560 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (774 bytes (3870.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,560 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (733 bytes) 09:58:35,560 TRACE (OOB-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87320, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,560 TRACE (OOB-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #5, conn_id=2) 09:58:35,560 TRACE (OOB-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#5 09:58:35,560 TRACE (OOB-1,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 09:58:35,561 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87323, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,561 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #6, conn_id=2) 09:58:35,561 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#6 09:58:35,562 TRACE (testng-Test:[DistInitialTransferListener]) [StateTransferManagerImpl] Waiting for initial state transfer to finish for cache DistInitialTransferListener on Test-NodeC-52778 09:58:35,561 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: Responses{ Test-NodeA-7051: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=true} , received=true, suspected=false} 09:58:35,561 TRACE (OOB-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=621 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87330, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,569 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253]} is {Test-NodeA-7051=SuccessfulResponse{responseValue=true} } 09:58:35,574 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [InboundTransferTask] Successfully requested segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] of cache DistInitialTransferListener from node Test-NodeA-7051 09:58:35,573 TRACE (OOB-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #7, conn_id=2) 09:58:35,577 TRACE (OOB-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#7 09:58:35,577 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Waiting for inbound transfer to finish: InboundTransferTask{segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253], finishedSegments=[], unfinishedSegments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253], source=Test-NodeA-7051, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=false, topologyId=4, timeout=240000, cacheName=DistInitialTransferListener} 09:58:35,578 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [SemaphoreCompletionService] Moving task to background, available permits 0 09:58:35,579 TRACE (OOB-3,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87330 09:58:35,579 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [SemaphoreCompletionService] Task finished, tasks in queue 1, available permits -1 09:58:35,579 TRACE (OOB-3,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=4} [sender=Test-NodeA-7051] 09:58:35,580 TRACE (OOB-3,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 4 09:58:35,580 TRACE (remote-thread-Test-NodeC-p23887-t3:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=4} 09:58:35,580 TRACE (OOB-3,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,581 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Before applying the received state the data container of cache DistInitialTransferListener has 0 keys 09:58:35,582 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 134 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,582 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 134 of cache DistInitialTransferListener 09:58:35,582 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 3 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,584 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 7 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,582 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 133 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,582 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 2 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,582 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 128 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,584 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 2 of cache DistInitialTransferListener 09:58:35,585 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 128 of cache DistInitialTransferListener 09:58:35,584 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 133 of cache DistInitialTransferListener 09:58:35,584 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 7 of cache DistInitialTransferListener 09:58:35,584 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 3 of cache DistInitialTransferListener 09:58:35,590 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 10 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,590 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 10 of cache DistInitialTransferListener 09:58:35,590 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 9 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,590 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 139 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,590 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 135 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,592 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 139 of cache DistInitialTransferListener 09:58:35,592 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 135 of cache DistInitialTransferListener 09:58:35,592 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 9 of cache DistInitialTransferListener 09:58:35,592 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 13 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,592 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 12 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,592 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 14 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,593 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 12 of cache DistInitialTransferListener 09:58:35,593 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 14 of cache DistInitialTransferListener 09:58:35,594 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 21 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,593 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 13 of cache DistInitialTransferListener 09:58:35,594 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 21 of cache DistInitialTransferListener 09:58:35,594 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 20 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,595 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 159 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,594 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 145 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,594 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 146 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,595 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 146 of cache DistInitialTransferListener 09:58:35,595 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 145 of cache DistInitialTransferListener 09:58:35,595 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 159 of cache DistInitialTransferListener 09:58:35,595 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 31 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,595 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 162 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,595 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 31 of cache DistInitialTransferListener 09:58:35,595 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 40 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,595 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 40 of cache DistInitialTransferListener 09:58:35,596 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 41 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,595 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 20 of cache DistInitialTransferListener 09:58:35,595 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 163 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,596 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 163 of cache DistInitialTransferListener 09:58:35,596 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 162 of cache DistInitialTransferListener 09:58:35,596 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 41 of cache DistInitialTransferListener 09:58:35,596 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 180 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,597 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 180 of cache DistInitialTransferListener 09:58:35,596 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 181 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,596 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 179 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,597 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 179 of cache DistInitialTransferListener 09:58:35,596 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 45 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,597 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 45 of cache DistInitialTransferListener 09:58:35,596 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 47 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,597 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 47 of cache DistInitialTransferListener 09:58:35,598 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 181 of cache DistInitialTransferListener 09:58:35,599 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 60 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,600 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 63 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,600 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 63 of cache DistInitialTransferListener 09:58:35,600 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 62 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,600 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 61 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,600 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 66 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,601 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 61 of cache DistInitialTransferListener 09:58:35,600 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 60 of cache DistInitialTransferListener 09:58:35,601 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 62 of cache DistInitialTransferListener 09:58:35,602 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 66 of cache DistInitialTransferListener 09:58:35,603 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 195 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,603 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 71 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,603 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 71 of cache DistInitialTransferListener 09:58:35,603 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 199 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,603 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 70 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,603 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 199 of cache DistInitialTransferListener 09:58:35,603 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 68 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,603 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 72 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,603 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 68 of cache DistInitialTransferListener 09:58:35,603 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 200 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,604 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 200 of cache DistInitialTransferListener 09:58:35,604 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 70 of cache DistInitialTransferListener 09:58:35,604 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 201 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,603 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 195 of cache DistInitialTransferListener 09:58:35,604 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 201 of cache DistInitialTransferListener 09:58:35,604 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 73 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,604 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 203 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,605 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 73 of cache DistInitialTransferListener 09:58:35,604 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 72 of cache DistInitialTransferListener 09:58:35,605 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 82 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,605 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 203 of cache DistInitialTransferListener 09:58:35,605 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 76 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,605 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 76 of cache DistInitialTransferListener 09:58:35,605 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 82 of cache DistInitialTransferListener 09:58:35,608 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 210 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,608 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 210 of cache DistInitialTransferListener 09:58:35,608 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 218 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,608 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 220 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,608 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 89 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,609 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 220 of cache DistInitialTransferListener 09:58:35,609 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 89 of cache DistInitialTransferListener 09:58:35,608 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 86 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,609 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 86 of cache DistInitialTransferListener 09:58:35,609 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 221 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,610 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 218 of cache DistInitialTransferListener 09:58:35,612 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 93 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,610 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 221 of cache DistInitialTransferListener 09:58:35,613 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 94 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,613 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 223 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,613 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 223 of cache DistInitialTransferListener 09:58:35,613 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 228 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,613 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 228 of cache DistInitialTransferListener 09:58:35,613 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 101 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,613 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 101 of cache DistInitialTransferListener 09:58:35,613 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 227 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,613 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 94 of cache DistInitialTransferListener 09:58:35,613 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 93 of cache DistInitialTransferListener 09:58:35,614 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 95 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,613 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 102 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,615 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 227 of cache DistInitialTransferListener 09:58:35,614 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 95 of cache DistInitialTransferListener 09:58:35,616 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 102 of cache DistInitialTransferListener 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 108 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 108 of cache DistInitialTransferListener 09:58:35,617 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 113 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 112 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,617 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 113 of cache DistInitialTransferListener 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 238 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 236 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 238 of cache DistInitialTransferListener 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 118 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,617 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 120 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,617 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 120 of cache DistInitialTransferListener 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 112 of cache DistInitialTransferListener 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 118 of cache DistInitialTransferListener 09:58:35,617 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 236 of cache DistInitialTransferListener 09:58:35,619 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 253 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,619 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 123 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,619 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 121 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,620 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 121 of cache DistInitialTransferListener 09:58:35,619 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 249 of cache DistInitialTransferListener from node Test-NodeA-7051: received 0 cache entries 09:58:35,620 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 123 of cache DistInitialTransferListener 09:58:35,619 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 253 of cache DistInitialTransferListener 09:58:35,620 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 249 of cache DistInitialTransferListener 09:58:35,624 DEBUG (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [InboundTransferTask] Finished receiving state for segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] of cache DistInitialTransferListener 09:58:35,624 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [SemaphoreCompletionService] Background task finished, executing cleanup task 09:58:35,624 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 1, available permits 0 09:58:35,624 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Removing inbound transfers for segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] from source Test-NodeA-7051 for cache DistInitialTransferListener 09:58:35,627 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] After applying the received state the data container of cache DistInitialTransferListener has 0 keys 09:58:35,627 TRACE (remote-thread-Test-NodeC-p23887-t3:[DistInitialTransferListener]) [StateConsumerImpl] Segments not received yet for cache DistInitialTransferListener: {Test-NodeB-10318=[InboundTransferTask{segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252], finishedSegments=[], unfinishedSegments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252], source=Test-NodeB-10318, isCancelled=false, isStartedSuccessfully=false, isCompletedSuccessfully=false, topologyId=4, timeout=240000, cacheName=DistInitialTransferListener}]} 09:58:35,627 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Inbound transfer finished: InboundTransferTask{segments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253], finishedSegments=[128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 159, 31, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 200, 72, 201, 73, 203, 76, 82, 210, 86, 89, 218, 220, 221, 93, 94, 223, 95, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253], unfinishedSegments=[], source=Test-NodeA-7051, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=4, timeout=240000, cacheName=DistInitialTransferListener} 09:58:35,629 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 1, available permits 0 09:58:35,629 TRACE (remote-thread-Test-NodeC-p23887-t3:[]) [CommandAwareRpcDispatcher] About to send back response null for command StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=4} 09:58:35,633 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,633 TRACE (remote-thread-Test-NodeC-p23887-t3:[]) [RequestCorrelator] sending rsp for 87330 to Test-NodeA-7051 09:58:35,635 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [InboundTransferTask] Requesting segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] of cache DistInitialTransferListener from node Test-NodeB-10318 09:58:35,635 TRACE (remote-thread-Test-NodeC-p23887-t3:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #9, conn_id=0) 09:58:35,642 TRACE (remote-thread-Test-NodeC-p23887-t3:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87330, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 09:58:35,642 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252]} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 09:58:35,645 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,645 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:35,645 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 09:58:35,647 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87330, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 09:58:35,647 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252]} to addresses [Test-NodeB-10318] with response mode GET_ALL 09:58:35,648 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #9, conn_id=0) 09:58:35,648 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#9 09:58:35,648 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:35,648 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=Test-NodeA-7051, topologyId=4} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:35,648 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [RequestCorrelator] Test-NodeC-52778: invoking multicast RPC [req-id=87357] 09:58:35,650 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [UNICAST3] Test-NodeC-52778: created sender window for Test-NodeB-10318 (conn-id=1) 09:58:35,650 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #1, conn_id=1, first) 09:58:35,650 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87357, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 09:58:35,650 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (611 bytes (3055.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:35,650 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [OutboundTransferTask] Outbound transfer of segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] of cache DistInitialTransferListener to node Test-NodeC-52778 is complete 09:58:35,650 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [StateProviderImpl] Removing completed outbound transfer of segments [128, 2, 3, 133, 134, 7, 135, 9, 10, 139, 12, 13, 14, 145, 146, 20, 21, 31, 159, 162, 163, 40, 41, 45, 47, 179, 180, 181, 60, 61, 62, 63, 66, 195, 68, 70, 71, 199, 72, 200, 73, 201, 203, 76, 82, 210, 86, 89, 218, 220, 93, 221, 94, 95, 223, 227, 228, 101, 102, 108, 236, 238, 112, 113, 118, 120, 121, 249, 123, 253] to Test-NodeC-52778 for cache DistInitialTransferListener 09:58:35,650 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (614 bytes) 09:58:35,651 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] 127.0.0.1:7902: connecting to 127.0.0.1:7901 09:58:35,652 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=537 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87357, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 09:58:35,652 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #1, conn_id=1, first) 09:58:35,652 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: created receiver window for Test-NodeC-52778 at seqno=#1 for conn-id=1 09:58:35,653 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#1 09:58:35,654 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87357 09:58:35,654 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252]} [sender=Test-NodeC-52778] 09:58:35,655 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,655 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252]} 09:58:35,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[DistInitialTransferListener]) [StateProviderImpl] Starting outbound transfer of segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] to node Test-NodeC-52778 with topology id 4 for cache DistInitialTransferListener 09:58:35,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[DistInitialTransferListener]) [StateProviderImpl] Adding outbound transfer of segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] to Test-NodeC-52778 09:58:35,657 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [OutboundTransferTask] Sending last chunk containing 0 cache entries from segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] of cache DistInitialTransferListener to node Test-NodeC-52778 09:58:35,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252]} 09:58:35,660 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}], origin=Test-NodeB-10318, topologyId=4} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:35,660 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}], origin=Test-NodeB-10318, topologyId=4}, mode=SYNCHRONOUS, timeout=240000 09:58:35,661 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}], origin=Test-NodeB-10318, topologyId=4} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:35,661 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87363] on Test-NodeC-52778 09:58:35,660 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87357 to Test-NodeC-52778 09:58:35,661 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [UNICAST3] Test-NodeB-10318: created sender window for Test-NodeC-52778 (conn-id=1) 09:58:35,663 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #1, conn_id=1, first) 09:58:35,663 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87363, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 09:58:35,663 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (895 bytes (4475.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,663 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (898 bytes) 09:58:35,663 TRACE (OOB-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=821 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87363, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 09:58:35,664 TRACE (OOB-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #1, conn_id=1, first) 09:58:35,664 TRACE (OOB-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: created receiver window for Test-NodeB-10318 at seqno=#1 for conn-id=1 09:58:35,664 TRACE (OOB-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#1 09:58:35,664 TRACE (OOB-3,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87363 09:58:35,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #2, conn_id=1) 09:58:35,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87357, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,664 TRACE (OOB-3,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}], origin=Test-NodeB-10318, topologyId=4} [sender=Test-NodeB-10318] 09:58:35,670 TRACE (OOB-3,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 4 09:58:35,671 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,671 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:58:35,670 TRACE (remote-thread-Test-NodeC-p23887-t4:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}], origin=Test-NodeB-10318, topologyId=4} 09:58:35,672 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Before applying the received state the data container of cache DistInitialTransferListener has 0 keys 09:58:35,672 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 130 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,672 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 130 of cache DistInitialTransferListener 09:58:35,672 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 131 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,670 TRACE (OOB-3,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,672 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 1 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,673 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 1 of cache DistInitialTransferListener 09:58:35,672 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 131 of cache DistInitialTransferListener 09:58:35,673 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 132 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,673 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 132 of cache DistInitialTransferListener 09:58:35,673 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 0 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,674 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87357, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,674 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #2, conn_id=1) 09:58:35,674 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#2 09:58:35,674 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: Responses{ Test-NodeB-10318: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=true} , received=true, suspected=false} 09:58:35,673 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 129 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,682 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 129 of cache DistInitialTransferListener 09:58:35,673 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 8 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,673 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 4 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,683 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 8 of cache DistInitialTransferListener 09:58:35,683 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 4 of cache DistInitialTransferListener 09:58:35,684 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 136 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,682 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 0 of cache DistInitialTransferListener 09:58:35,681 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252]} is {Test-NodeB-10318=SuccessfulResponse{responseValue=true} } 09:58:35,684 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [InboundTransferTask] Successfully requested segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] of cache DistInitialTransferListener from node Test-NodeB-10318 09:58:35,684 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Waiting for inbound transfer to finish: InboundTransferTask{segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252], finishedSegments=[0, 1, 129, 130, 131, 132, 4, 8], unfinishedSegments=[136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252], source=Test-NodeB-10318, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=false, topologyId=4, timeout=240000, cacheName=DistInitialTransferListener} 09:58:35,685 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [SemaphoreCompletionService] Moving task to background, available permits 0 09:58:35,685 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits -1 09:58:35,684 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 136 of cache DistInitialTransferListener 09:58:35,683 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 137 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,687 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 137 of cache DistInitialTransferListener 09:58:35,691 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 138 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,691 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 138 of cache DistInitialTransferListener 09:58:35,691 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 18 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,698 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 18 of cache DistInitialTransferListener 09:58:35,691 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 19 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,691 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 17 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,691 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 16 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,691 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 15 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,698 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 16 of cache DistInitialTransferListener 09:58:35,698 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 15 of cache DistInitialTransferListener 09:58:35,698 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 17 of cache DistInitialTransferListener 09:58:35,698 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 19 of cache DistInitialTransferListener 09:58:35,707 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 147 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,707 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 149 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,707 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 149 of cache DistInitialTransferListener 09:58:35,707 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 147 of cache DistInitialTransferListener 09:58:35,707 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 150 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,707 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 148 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,707 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 150 of cache DistInitialTransferListener 09:58:35,708 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 151 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,708 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 152 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,709 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 152 of cache DistInitialTransferListener 09:58:35,708 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 151 of cache DistInitialTransferListener 09:58:35,708 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 153 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,708 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 154 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,710 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 154 of cache DistInitialTransferListener 09:58:35,710 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 148 of cache DistInitialTransferListener 09:58:35,710 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 156 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,710 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 156 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 29 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 29 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 157 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 157 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 30 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 30 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 158 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 158 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 164 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 164 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 38 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 38 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 39 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 39 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 44 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 44 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 46 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 46 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 48 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 48 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 59 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 59 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 193 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 193 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 194 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 194 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 67 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 67 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 69 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 69 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 74 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 74 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 202 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 202 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 75 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 75 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 204 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 204 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 77 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 77 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 205 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 205 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 78 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 78 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 206 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 206 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 207 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 207 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 80 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 80 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 208 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 208 of cache DistInitialTransferListener 09:58:35,710 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 155 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 81 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 81 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 83 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 209 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,711 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 153 of cache DistInitialTransferListener 09:58:35,711 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 209 of cache DistInitialTransferListener 09:58:35,711 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 83 of cache DistInitialTransferListener 09:58:35,712 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 90 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,712 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 85 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,712 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 85 of cache DistInitialTransferListener 09:58:35,711 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 155 of cache DistInitialTransferListener 09:58:35,712 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 90 of cache DistInitialTransferListener 09:58:35,712 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 84 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,713 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 91 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,713 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 84 of cache DistInitialTransferListener 09:58:35,713 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 91 of cache DistInitialTransferListener 09:58:35,713 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 219 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,713 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 92 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,714 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 92 of cache DistInitialTransferListener 09:58:35,714 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 219 of cache DistInitialTransferListener 09:58:35,714 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 222 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,714 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 96 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,715 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 96 of cache DistInitialTransferListener 09:58:35,714 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 97 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,715 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 97 of cache DistInitialTransferListener 09:58:35,714 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Applying new state chunk for segment 224 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,715 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 99 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,715 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Applying new state chunk for segment 98 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,715 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 226 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,715 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 99 of cache DistInitialTransferListener 09:58:35,716 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 226 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 229 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 229 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 103 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 103 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 231 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 231 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 232 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 232 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 233 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 233 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 106 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 106 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 234 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 234 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 107 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 107 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 235 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 235 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 239 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 239 of cache DistInitialTransferListener 09:58:35,715 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 222 of cache DistInitialTransferListener 09:58:35,716 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 230 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,716 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 230 of cache DistInitialTransferListener 09:58:35,716 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 240 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 240 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 115 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 115 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 243 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 243 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 116 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 116 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 244 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 244 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 117 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 117 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 245 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 245 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 119 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 119 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 247 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 247 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 248 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 248 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 122 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 122 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 251 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 251 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 124 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 124 of cache DistInitialTransferListener 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Applying new state chunk for segment 252 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,719 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Finished applying chunk of segment 252 of cache DistInitialTransferListener 09:58:35,716 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished applying chunk of segment 224 of cache DistInitialTransferListener 09:58:35,716 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t2:[]) [StateConsumerImpl] Finished applying chunk of segment 98 of cache DistInitialTransferListener 09:58:35,720 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Applying new state chunk for segment 241 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,720 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t1:[]) [StateConsumerImpl] Finished applying chunk of segment 241 of cache DistInitialTransferListener 09:58:35,720 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Applying new state chunk for segment 242 of cache DistInitialTransferListener from node Test-NodeB-10318: received 0 cache entries 09:58:35,720 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [StateConsumerImpl] Finished applying chunk of segment 242 of cache DistInitialTransferListener 09:58:35,722 DEBUG (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [InboundTransferTask] Finished receiving state for segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] of cache DistInitialTransferListener 09:58:35,722 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t4:[]) [SemaphoreCompletionService] Background task finished, executing cleanup task 09:58:35,724 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] After applying the received state the data container of cache DistInitialTransferListener has 0 keys 09:58:35,724 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,724 TRACE (remote-thread-Test-NodeC-p23887-t4:[DistInitialTransferListener]) [StateConsumerImpl] Segments not received yet for cache DistInitialTransferListener: {Test-NodeB-10318=[InboundTransferTask{segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252], finishedSegments=[0, 1, 129, 130, 131, 132, 4, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 226, 98, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252], unfinishedSegments=[], source=Test-NodeB-10318, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=4, timeout=240000, cacheName=DistInitialTransferListener}]} 09:58:35,724 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Removing inbound transfers for segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] from source Test-NodeB-10318 for cache DistInitialTransferListener 09:58:35,724 TRACE (remote-thread-Test-NodeC-p23887-t4:[]) [CommandAwareRpcDispatcher] About to send back response null for command StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}], origin=Test-NodeB-10318, topologyId=4} 09:58:35,725 TRACE (remote-thread-Test-NodeC-p23887-t4:[]) [RequestCorrelator] sending rsp for 87363 to Test-NodeB-10318 09:58:35,725 TRACE (remote-thread-Test-NodeC-p23887-t4:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #2, conn_id=1) 09:58:35,725 TRACE (remote-thread-Test-NodeC-p23887-t4:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87363, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,725 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:35,725 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:35,724 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Inbound transfer finished: InboundTransferTask{segments=[0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252], finishedSegments=[0, 1, 129, 130, 131, 132, 4, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 226, 98, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252], unfinishedSegments=[], source=Test-NodeB-10318, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=4, timeout=240000, cacheName=DistInitialTransferListener} 09:58:35,733 DEBUG (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Finished receiving of segments for cache DistInitialTransferListener for topology 4. 09:58:35,733 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87363, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,734 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #2, conn_id=1) 09:58:35,735 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:35,735 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#2 09:58:35,736 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:35,736 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StateResponseCommand{cache=DistInitialTransferListener, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}], origin=Test-NodeB-10318, topologyId=4} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:35,737 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [OutboundTransferTask] Outbound transfer of segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] of cache DistInitialTransferListener to node Test-NodeC-52778 is complete 09:58:35,737 TRACE (transport-thread-Test-NodeB-p23777-t1:[]) [StateProviderImpl] Removing completed outbound transfer of segments [0, 1, 129, 130, 131, 4, 132, 8, 136, 137, 138, 15, 16, 17, 18, 19, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 29, 157, 30, 158, 164, 38, 39, 44, 46, 48, 59, 193, 194, 67, 69, 74, 202, 75, 204, 77, 205, 78, 206, 207, 80, 208, 81, 209, 83, 84, 85, 90, 91, 219, 92, 222, 96, 224, 97, 98, 226, 99, 229, 230, 103, 231, 232, 233, 106, 234, 107, 235, 239, 240, 241, 242, 115, 243, 116, 244, 117, 245, 119, 247, 248, 122, 251, 124, 252] to Test-NodeC-52778 for cache DistInitialTransferListener 09:58:35,737 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,737 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,739 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeC-52778, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=0 09:58:35,739 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeC-52778, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient Test-NodeA-7051 with response mode GET_NONE 09:58:35,740 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #10, conn_id=0) 09:58:35,740 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 09:58:35,747 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (139 bytes (695.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,747 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (142 bytes) 09:58:35,747 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,747 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=68 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 09:58:35,754 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #10, conn_id=0) 09:58:35,754 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#10 09:58:35,754 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:35,754 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_CONFIRM, sender=Test-NodeC-52778, joinInfo=null, topologyId=4, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} [sender=Test-NodeC-52778] 09:58:35,755 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,755 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] ISPN000328: Finished local rebalance for cache DistInitialTransferListener on node Test-NodeC-52778, topology id = 4 09:58:35,755 INFO (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener][Scope=Test-NodeC-52778]ISPN100003: Finished local rebalance 09:58:35,755 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Rebalance confirmation collector 4@DistInitialTransferListener received confirmation for Test-NodeC-52778, remaining list is [] 09:58:35,761 INFO (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] ISPN000336: Finished cluster-wide rebalance for cache DistInitialTransferListener, topology id = 4 09:58:35,761 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]}, members = [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], joiners = [] 09:58:35,761 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 1 2, 1: 1 2, 2: 2 0, 3: 0 2, 4: 2 0, 5: 0 1, 6: 1 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 2 1, 11: 1 0, 12: 0 2, 13: 0 2, 14: 2 1, 15: 2 1, 16: 2 1, 17: 1 2, 18: 2 0, 19: 2 0, 20: 0 2, 21: 2 0, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 2, 30: 2 1, 31: 2 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 2, 39: 1 2, 40: 2 1, 41: 2 1, 42: 1 0, 43: 0 1, 44: 1 2, 45: 2 1, 46: 1 2, 47: 2 0, 48: 2 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 2, 60: 2 0, 61: 0 2, 62: 0 2, 63: 2 1, 64: 1 0, 65: 1 0, 66: 0 2, 67: 2 0, 68: 0 2, 69: 2 0, 70: 0 2, 71: 2 0, 72: 2 0, 73: 0 2, 74: 2 1, 75: 1 2, 76: 2 1, 77: 1 2, 78: 2 0, 79: 0 1, 80: 1 2, 81: 2 1, 82: 2 1, 83: 2 1, 84: 1 2, 85: 2 1, 86: 2 1, 87: 1 0, 88: 1 0, 89: 0 2, 90: 2 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 2 0, 95: 0 2, 96: 2 1, 97: 1 2, 98: 2 1, 99: 2 1, 100: 1 0, 101: 0 2, 102: 0 2, 103: 2 0, 104: 0 1, 105: 0 1, 106: 1 2, 107: 2 0, 108: 2 0, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 2, 113: 2 0, 114: 0 1, 115: 1 2, 116: 1 2, 117: 1 2, 118: 2 0, 119: 2 0, 120: 2 0, 121: 0 2, 122: 2 0, 123: 0 2, 124: 2 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 2, 129: 2 0, 130: 2 0, 131: 2 0, 132: 2 0, 133: 2 0, 134: 0 2, 135: 2 1, 136: 1 2, 137: 1 2, 138: 1 2, 139: 2 0, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 2, 146: 0 2, 147: 2 1, 148: 2 1, 149: 1 2, 150: 1 2, 151: 2 1, 152: 1 2, 153: 2 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 1 2, 158: 2 1, 159: 2 1, 160: 1 0, 161: 1 0, 162: 0 2, 163: 0 2, 164: 2 1, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 2, 180: 2 1, 181: 2 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 2, 194: 1 2, 195: 2 0, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 2, 200: 0 2, 201: 2 1, 202: 1 2, 203: 2 1, 204: 1 2, 205: 2 1, 206: 1 2, 207: 1 2, 208: 1 2, 209: 1 2, 210: 2 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 2, 219: 2 0, 220: 0 2, 221: 0 2, 222: 2 0, 223: 0 2, 224: 2 0, 225: 0 1, 226: 1 2, 227: 2 1, 228: 2 1, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 0, 238: 0 2, 239: 2 1, 240: 2 1, 241: 2 1, 242: 1 2, 243: 1 2, 244: 1 2, 245: 2 0, 246: 0 1, 247: 1 2, 248: 1 2, 249: 2 0, 250: 0 1, 251: 1 2, 252: 1 2, 253: 2 1, 254: 1 0, 255: 0 1 09:58:35,762 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache DistInitialTransferListener, topology = CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]}, availability mode = AVAILABLE 09:58:35,763 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} 09:58:35,763 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 09:58:35,763 TRACE (transport-thread-Test-NodeA-p23728-t5:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,763 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,763 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:58:35,765 DEBUG (transport-thread-Test-NodeA-p23728-t5:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,765 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [CacheTopology] Current consistent hash's routing table: 0: 1 2, 1: 1 2, 2: 2 0, 3: 0 2, 4: 2 0, 5: 0 1, 6: 1 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 2 1, 11: 1 0, 12: 0 2, 13: 0 2, 14: 2 1, 15: 2 1, 16: 2 1, 17: 1 2, 18: 2 0, 19: 2 0, 20: 0 2, 21: 2 0, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 2, 30: 2 1, 31: 2 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 2, 39: 1 2, 40: 2 1, 41: 2 1, 42: 1 0, 43: 0 1, 44: 1 2, 45: 2 1, 46: 1 2, 47: 2 0, 48: 2 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 2, 60: 2 0, 61: 0 2, 62: 0 2, 63: 2 1, 64: 1 0, 65: 1 0, 66: 0 2, 67: 2 0, 68: 0 2, 69: 2 0, 70: 0 2, 71: 2 0, 72: 2 0, 73: 0 2, 74: 2 1, 75: 1 2, 76: 2 1, 77: 1 2, 78: 2 0, 79: 0 1, 80: 1 2, 81: 2 1, 82: 2 1, 83: 2 1, 84: 1 2, 85: 2 1, 86: 2 1, 87: 1 0, 88: 1 0, 89: 0 2, 90: 2 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 2 0, 95: 0 2, 96: 2 1, 97: 1 2, 98: 2 1, 99: 2 1, 100: 1 0, 101: 0 2, 102: 0 2, 103: 2 0, 104: 0 1, 105: 0 1, 106: 1 2, 107: 2 0, 108: 2 0, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 2, 113: 2 0, 114: 0 1, 115: 1 2, 116: 1 2, 117: 1 2, 118: 2 0, 119: 2 0, 120: 2 0, 121: 0 2, 122: 2 0, 123: 0 2, 124: 2 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 2, 129: 2 0, 130: 2 0, 131: 2 0, 132: 2 0, 133: 2 0, 134: 0 2, 135: 2 1, 136: 1 2, 137: 1 2, 138: 1 2, 139: 2 0, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 2, 146: 0 2, 147: 2 1, 148: 2 1, 149: 1 2, 150: 1 2, 151: 2 1, 152: 1 2, 153: 2 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 1 2, 158: 2 1, 159: 2 1, 160: 1 0, 161: 1 0, 162: 0 2, 163: 0 2, 164: 2 1, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 2, 180: 2 1, 181: 2 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 2, 194: 1 2, 195: 2 0, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 2, 200: 0 2, 201: 2 1, 202: 1 2, 203: 2 1, 204: 1 2, 205: 2 1, 206: 1 2, 207: 1 2, 208: 1 2, 209: 1 2, 210: 2 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 2, 219: 2 0, 220: 0 2, 221: 0 2, 222: 2 0, 223: 0 2, 224: 2 0, 225: 0 1, 226: 1 2, 227: 2 1, 228: 2 1, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 0, 238: 0 2, 239: 2 1, 240: 2 1, 241: 2 1, 242: 1 2, 243: 1 2, 244: 1 2, 245: 2 0, 246: 0 1, 247: 1 2, 248: 1 2, 249: 2 0, 250: 0 1, 251: 1 2, 252: 1 2, 253: 2 1, 254: 1 0, 255: 0 1 09:58:35,765 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:58:35,765 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} to addresses null with response mode GET_NONE 09:58:35,765 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = true, topology = CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,767 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateTransferLockImpl] Signalling topology 5 is installed 09:58:35,767 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 32, 33, 34, 35, 36, 37, 42, 43, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 60, 61, 62, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 78, 79, 87, 88, 89, 93, 94, 95, 100, 101, 102, 103, 104, 105, 107, 108, 109, 110, 111, 112, 113, 114, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 139, 140, 141, 142, 143, 144, 145, 146, 160, 161, 162, 163, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 195, 196, 197, 198, 199, 200, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 237, 238, 245, 246, 249, 250, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [0, 1, 10, 14, 15, 16, 17, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 59, 63, 74, 75, 76, 77, 80, 81, 82, 83, 84, 85, 86, 90, 91, 92, 96, 97, 98, 99, 106, 115, 116, 117, 135, 136, 137, 138, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 164, 180, 181, 193, 194, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 239, 240, 241, 242, 243, 244, 247, 248, 251, 252, 253] 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 4, startRebalance = false, pending CH = null 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [LocalStreamManagerImpl] Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} with new topology 5 and was pre false 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [LocalStreamManagerImpl] No change listeners present! 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateConsumerImpl] Unlock State Transfer in Progress for topology ID 5 09:58:35,768 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [StateTransferLockImpl] Signalling transaction data received for topology 5 09:58:35,768 DEBUG (transport-thread-Test-NodeA-p23728-t5:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:35,769 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#5 09:58:35,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 09:58:35,771 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (3404 bytes (17020.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:35,771 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (3407 bytes) 09:58:35,771 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [MFC] Test-NodeA-7051 used 3353 credits, 1990148 remaining 09:58:35,773 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (3407 bytes) 09:58:35,773 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=3353 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 09:58:35,773 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (3 headers), size=3353 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 09:58:35,774 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received Test-NodeA-7051#5 09:58:35,773 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#5 09:58:35,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,774 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#5 09:58:35,774 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: delivering Test-NodeA-7051#5 09:58:35,775 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:35,776 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:35,775 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterTopologyManagerImpl] Updating cluster-wide stable topology for cache DistInitialTransferListener, topology = CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,776 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} 09:58:35,776 TRACE (transport-thread-Test-NodeA-p23728-t4:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,776 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,776 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [LocalTopologyManagerImpl] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,776 TRACE (transport-thread-Test-NodeA-p23728-t4:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,776 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:58:35,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,776 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,777 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:58:35,777 TRACE (remote-thread-Test-NodeC-p23887-t5:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,777 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,777 TRACE (OOB-2,Test-NodeC-52778:[]) [MFC] Test-NodeA-7051 used 3353 credits, 1990148 remaining 09:58:35,778 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,776 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:58:35,776 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,776 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 09:58:35,778 DEBUG (transport-thread-Test-NodeB-p23777-t2:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,778 TRACE (OOB-3,Test-NodeB-10318:[]) [MFC] Test-NodeA-7051 used 3353 credits, 1990148 remaining 09:58:35,778 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:58:35,779 DEBUG (transport-thread-Test-NodeC-p23889-t3:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,780 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [CacheTopology] Current consistent hash's routing table: 0: 1 2, 1: 1 2, 2: 2 0, 3: 0 2, 4: 2 0, 5: 0 1, 6: 1 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 2 1, 11: 1 0, 12: 0 2, 13: 0 2, 14: 2 1, 15: 2 1, 16: 2 1, 17: 1 2, 18: 2 0, 19: 2 0, 20: 0 2, 21: 2 0, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 2, 30: 2 1, 31: 2 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 2, 39: 1 2, 40: 2 1, 41: 2 1, 42: 1 0, 43: 0 1, 44: 1 2, 45: 2 1, 46: 1 2, 47: 2 0, 48: 2 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 2, 60: 2 0, 61: 0 2, 62: 0 2, 63: 2 1, 64: 1 0, 65: 1 0, 66: 0 2, 67: 2 0, 68: 0 2, 69: 2 0, 70: 0 2, 71: 2 0, 72: 2 0, 73: 0 2, 74: 2 1, 75: 1 2, 76: 2 1, 77: 1 2, 78: 2 0, 79: 0 1, 80: 1 2, 81: 2 1, 82: 2 1, 83: 2 1, 84: 1 2, 85: 2 1, 86: 2 1, 87: 1 0, 88: 1 0, 89: 0 2, 90: 2 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 2 0, 95: 0 2, 96: 2 1, 97: 1 2, 98: 2 1, 99: 2 1, 100: 1 0, 101: 0 2, 102: 0 2, 103: 2 0, 104: 0 1, 105: 0 1, 106: 1 2, 107: 2 0, 108: 2 0, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 2, 113: 2 0, 114: 0 1, 115: 1 2, 116: 1 2, 117: 1 2, 118: 2 0, 119: 2 0, 120: 2 0, 121: 0 2, 122: 2 0, 123: 0 2, 124: 2 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 2, 129: 2 0, 130: 2 0, 131: 2 0, 132: 2 0, 133: 2 0, 134: 0 2, 135: 2 1, 136: 1 2, 137: 1 2, 138: 1 2, 139: 2 0, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 2, 146: 0 2, 147: 2 1, 148: 2 1, 149: 1 2, 150: 1 2, 151: 2 1, 152: 1 2, 153: 2 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 1 2, 158: 2 1, 159: 2 1, 160: 1 0, 161: 1 0, 162: 0 2, 163: 0 2, 164: 2 1, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 2, 180: 2 1, 181: 2 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 2, 194: 1 2, 195: 2 0, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 2, 200: 0 2, 201: 2 1, 202: 1 2, 203: 2 1, 204: 1 2, 205: 2 1, 206: 1 2, 207: 1 2, 208: 1 2, 209: 1 2, 210: 2 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 2, 219: 2 0, 220: 0 2, 221: 0 2, 222: 2 0, 223: 0 2, 224: 2 0, 225: 0 1, 226: 1 2, 227: 2 1, 228: 2 1, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 0, 238: 0 2, 239: 2 1, 240: 2 1, 241: 2 1, 242: 1 2, 243: 1 2, 244: 1 2, 245: 2 0, 246: 0 1, 247: 1 2, 248: 1 2, 249: 2 0, 250: 0 1, 251: 1 2, 252: 1 2, 253: 2 1, 254: 1 0, 255: 0 1 09:58:35,779 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [CacheTopology] Current consistent hash's routing table: 0: 1 2, 1: 1 2, 2: 2 0, 3: 0 2, 4: 2 0, 5: 0 1, 6: 1 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 2 1, 11: 1 0, 12: 0 2, 13: 0 2, 14: 2 1, 15: 2 1, 16: 2 1, 17: 1 2, 18: 2 0, 19: 2 0, 20: 0 2, 21: 2 0, 22: 0 1, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 1 0, 28: 0 1, 29: 1 2, 30: 2 1, 31: 2 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 2, 39: 1 2, 40: 2 1, 41: 2 1, 42: 1 0, 43: 0 1, 44: 1 2, 45: 2 1, 46: 1 2, 47: 2 0, 48: 2 0, 49: 0 1, 50: 0 1, 51: 0 1, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 1 0, 58: 0 1, 59: 1 2, 60: 2 0, 61: 0 2, 62: 0 2, 63: 2 1, 64: 1 0, 65: 1 0, 66: 0 2, 67: 2 0, 68: 0 2, 69: 2 0, 70: 0 2, 71: 2 0, 72: 2 0, 73: 0 2, 74: 2 1, 75: 1 2, 76: 2 1, 77: 1 2, 78: 2 0, 79: 0 1, 80: 1 2, 81: 2 1, 82: 2 1, 83: 2 1, 84: 1 2, 85: 2 1, 86: 2 1, 87: 1 0, 88: 1 0, 89: 0 2, 90: 2 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 2 0, 95: 0 2, 96: 2 1, 97: 1 2, 98: 2 1, 99: 2 1, 100: 1 0, 101: 0 2, 102: 0 2, 103: 2 0, 104: 0 1, 105: 0 1, 106: 1 2, 107: 2 0, 108: 2 0, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 2, 113: 2 0, 114: 0 1, 115: 1 2, 116: 1 2, 117: 1 2, 118: 2 0, 119: 2 0, 120: 2 0, 121: 0 2, 122: 2 0, 123: 0 2, 124: 2 0, 125: 0 1, 126: 0 1, 127: 1 0, 128: 0 2, 129: 2 0, 130: 2 0, 131: 2 0, 132: 2 0, 133: 2 0, 134: 0 2, 135: 2 1, 136: 1 2, 137: 1 2, 138: 1 2, 139: 2 0, 140: 0 1, 141: 0 1, 142: 1 0, 143: 0 1, 144: 1 0, 145: 0 2, 146: 0 2, 147: 2 1, 148: 2 1, 149: 1 2, 150: 1 2, 151: 2 1, 152: 1 2, 153: 2 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 1 2, 158: 2 1, 159: 2 1, 160: 1 0, 161: 1 0, 162: 0 2, 163: 0 2, 164: 2 1, 165: 1 0, 166: 0 1, 167: 0 1, 168: 1 0, 169: 0 1, 170: 0 1, 171: 0 1, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 0 1, 177: 1 0, 178: 1 0, 179: 0 2, 180: 2 1, 181: 2 1, 182: 1 0, 183: 1 0, 184: 1 0, 185: 0 1, 186: 1 0, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 0 1, 193: 1 2, 194: 1 2, 195: 2 0, 196: 0 1, 197: 0 1, 198: 1 0, 199: 0 2, 200: 0 2, 201: 2 1, 202: 1 2, 203: 2 1, 204: 1 2, 205: 2 1, 206: 1 2, 207: 1 2, 208: 1 2, 209: 1 2, 210: 2 1, 211: 1 0, 212: 0 1, 213: 0 1, 214: 0 1, 215: 0 1, 216: 1 0, 217: 1 0, 218: 0 2, 219: 2 0, 220: 0 2, 221: 0 2, 222: 2 0, 223: 0 2, 224: 2 0, 225: 0 1, 226: 1 2, 227: 2 1, 228: 2 1, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 0, 238: 0 2, 239: 2 1, 240: 2 1, 241: 2 1, 242: 1 2, 243: 1 2, 244: 1 2, 245: 2 0, 246: 0 1, 247: 1 2, 248: 1 2, 249: 2 0, 250: 0 1, 251: 1 2, 252: 1 2, 253: 2 1, 254: 1 0, 255: 0 1 09:58:35,779 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} to addresses null with response mode GET_NONE 09:58:35,780 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:58:35,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#6 09:58:35,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 09:58:35,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [MFC] Test-NodeA-7051 used 3352 credits, 1986796 remaining 09:58:35,780 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (3403 bytes (17015.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:35,780 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (3406 bytes) 09:58:35,780 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = true, topology = CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,781 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateTransferLockImpl] Signalling topology 5 is installed 09:58:35,781 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=3352 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 09:58:35,780 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:58:35,781 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = true, topology = CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,781 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#6 09:58:35,783 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#6 09:58:35,783 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 5, 6, 10, 11, 14, 15, 16, 17, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 63, 64, 65, 74, 75, 76, 77, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 90, 91, 92, 96, 97, 98, 99, 100, 104, 105, 106, 109, 110, 111, 114, 115, 116, 117, 125, 126, 127, 135, 136, 137, 138, 140, 141, 142, 143, 144, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 196, 197, 198, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 239, 240, 241, 242, 243, 244, 246, 247, 248, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [2, 3, 4, 7, 8, 9, 12, 13, 18, 19, 20, 21, 47, 48, 60, 61, 62, 66, 67, 68, 69, 70, 71, 72, 73, 78, 89, 93, 94, 95, 101, 102, 103, 107, 108, 112, 113, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 139, 145, 146, 162, 163, 179, 195, 199, 200, 218, 219, 220, 221, 222, 223, 224, 238, 245, 249] 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 4, startRebalance = false, pending CH = null 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [LocalStreamManagerImpl] Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} with new topology 5 and was pre false 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [LocalStreamManagerImpl] No change listeners present! 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Unlock State Transfer in Progress for topology ID 5 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [StateTransferLockImpl] Signalling transaction data received for topology 5 09:58:35,784 DEBUG (transport-thread-Test-NodeB-p23777-t2:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:35,784 TRACE (transport-thread-Test-NodeB-p23777-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,781 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (3406 bytes) 09:58:35,784 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:58:35,785 TRACE (remote-thread-Test-NodeB-p23775-t6:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:58:35,786 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateTransferLockImpl] Signalling topology 5 is installed 09:58:35,786 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253]; old segments: [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253] 09:58:35,786 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [] 09:58:35,786 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 4, startRebalance = false, pending CH = null 09:58:35,787 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (3 headers), size=3352 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 09:58:35,787 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received Test-NodeA-7051#6 09:58:35,787 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: delivering Test-NodeA-7051#6 09:58:35,787 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:58:35,787 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=STABLE_TOPOLOGY_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, availabilityMode=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:58:35,787 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,787 TRACE (OOB-2,Test-NodeC-52778:[]) [MFC] Test-NodeA-7051 used 3352 credits, 1986796 remaining 09:58:35,786 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateConsumerImpl] Stop keeping track of changed keys for state transfer 09:58:35,788 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:58:35,785 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,789 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [LocalTopologyManagerImpl] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,789 TRACE (transport-thread-Test-NodeB-p23777-t3:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,785 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,789 TRACE (OOB-3,Test-NodeB-10318:[]) [MFC] Test-NodeA-7051 used 3352 credits, 1986796 remaining 09:58:35,788 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:58:35,787 TRACE (remote-thread-Test-NodeC-p23887-t6:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 0 09:58:35,793 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [LocalStreamManagerImpl] Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeA-7051: 122+134, Test-NodeB-10318: 134+122]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} with new topology 5 and was pre false 09:58:35,794 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [LocalStreamManagerImpl] No change listeners present! 09:58:35,794 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateConsumerImpl] Unlock State Transfer in Progress for topology ID 5 09:58:35,794 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateTransferLockImpl] Signalling transaction data received for topology 5 09:58:35,796 DEBUG (transport-thread-Test-NodeC-p23889-t3:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:58:35,797 DEBUG (testng-Test:[DistInitialTransferListener]) [CacheImpl] Started cache DistInitialTransferListener on Test-NodeC-52778 09:58:35,798 TRACE (testng-Test:[DistInitialTransferListener]) [DefaultCacheManager] Closing latch for cache DistInitialTransferListener 09:58:35,797 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [StateTransferManagerImpl] Initial state transfer complete for cache DistInitialTransferListener on node Test-NodeC-52778 09:58:35,800 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [SemaphoreCompletionService] Task finished, tasks in queue 1, available permits 0 09:58:35,800 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:58:35,806 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #2) 09:58:35,806 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=2, conn_id=1, ts=3, TP: [cluster_name=ISPN] 09:58:35,806 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,805 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [LocalTopologyManagerImpl] Updating stable topology for cache DistInitialTransferListener: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:58:35,807 TRACE (transport-thread-Test-NodeC-p23889-t3:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:58:35,806 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:35,808 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=2, conn_id=1, ts=3, TP: [cluster_name=ISPN] 09:58:35,809 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #2, conn-id=1, ts=3) 09:58:35,899 TRACE (testng-Test:[]) [TestingUtil] Node Test-NodeA-7051 finished state transfer. 09:58:35,899 TRACE (testng-Test:[]) [TestingUtil] Node Test-NodeB-10318 finished state transfer. 09:58:35,899 TRACE (testng-Test:[]) [TestingUtil] Node Test-NodeC-52778 finished state transfer. 09:58:35,899 DEBUG (testng-Test:[]) [Test] Cache managers created, ready to start the test 09:58:35,900 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeClass 09:58:35,904 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:35,904 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:35,904 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganAndCompletedSegmentValueNonOwnerClustered 09:58:35,905 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3a3e733] 09:58:35,905 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:35,905 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:35,905 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:35,905 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:35,905 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:35,905 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:35,905 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:35,905 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:35,905 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:35,905 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:35,905 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87405] on Test-NodeB-10318 09:58:35,905 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #12, conn_id=1) 09:58:35,905 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87405, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,905 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:35,905 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:35,905 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87405, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,905 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #12, conn_id=1) 09:58:35,905 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#12 09:58:35,905 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87405 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35576. timeout=10000 (MILLISECONDS) 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35576. Timeout=10000 (MILLISECONDS) 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35576} 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35576}. Current=null 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35576}) => true 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35576}. WAITING => ACQUIRED 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35576} successfully acquired the lock. 09:58:35,906 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,907 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:35,907 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:35,907 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7bef7ebb] 09:58:35,907 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:35,907 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:35,912 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35576. timeout=10000 (MILLISECONDS) 09:58:35,913 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35576. Timeout=10000 (MILLISECONDS) 09:58:35,915 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35576} 09:58:35,915 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:35,916 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:35,923 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:35,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:35,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:35,929 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(624500d1){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:35,931 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:35,931 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:35,931 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:35,935 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:35,940 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:35,940 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87412] on Test-NodeC-52778 09:58:35,941 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #3, conn_id=1) 09:58:35,941 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87412, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,941 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,941 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:35,944 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87412, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,947 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #3, conn_id=1) 09:58:35,947 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#3 09:58:35,949 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87412 09:58:35,950 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:35,950 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:35,952 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@74156da0] 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:35,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:35,954 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:35,955 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7ad28d52){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:35,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:35,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:35,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7ad28d52){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:35,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:35,967 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:35,967 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:35,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:35,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:35,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:35,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:35,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87412 to Test-NodeB-10318 09:58:35,971 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #3, conn_id=1) 09:58:35,971 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87412, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,971 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:35,971 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:35,971 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35576 09:58:35,971 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87412, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 09:58:35,972 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #3, conn_id=1) 09:58:35,972 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#3 09:58:35,972 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:35,972 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(624500d1){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35576 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35576. 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35576}. ACQUIRED => RELEASED 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35576}? true 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35576} 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35576}, null) => true 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87405 to Test-NodeA-7051 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #14, conn_id=0) 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87405, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 09:58:35,972 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:35,979 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:35,979 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87405, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 09:58:35,979 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #14, conn_id=0) 09:58:35,979 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#14 09:58:35,979 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:35,980 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:35,980 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:35,980 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3059a298] 09:58:35,980 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:35,980 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:35,972 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35576 09:58:35,982 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #14) 09:58:35,982 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=14, ts=5, TP: [cluster_name=ISPN] 09:58:35,983 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #10) 09:58:35,983 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=10, ts=6, TP: [cluster_name=ISPN] 09:58:35,983 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #3) 09:58:35,983 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=3, conn_id=1, ts=2, TP: [cluster_name=ISPN] 09:58:35,983 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #7) 09:58:35,983 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=7, conn_id=2, ts=3, TP: [cluster_name=ISPN] 09:58:35,980 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:35,985 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:35,983 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:35,983 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:35,986 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:35,986 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:35,986 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, ts=6, TP: [cluster_name=ISPN] 09:58:35,986 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #10, conn-id=0, ts=6) 09:58:35,986 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=14, ts=5, TP: [cluster_name=ISPN] 09:58:35,986 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #14, conn-id=0, ts=5) 09:58:35,986 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:35,986 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:35,987 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:35,987 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:35,987 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:35,987 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=3, conn_id=1, ts=2, TP: [cluster_name=ISPN] 09:58:35,986 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:35,987 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=7, conn_id=2, ts=3, TP: [cluster_name=ISPN] 09:58:35,987 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #7, conn-id=2, ts=3) 09:58:35,987 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #3, conn-id=1, ts=2) 09:58:35,987 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:35,988 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:35,988 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87418] on Test-NodeC-52778 09:58:35,988 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #8, conn_id=2) 09:58:35,988 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87418, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,988 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:35,988 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:35,989 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87418, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 09:58:35,990 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #8, conn_id=2) 09:58:35,992 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#8 09:58:35,992 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87418 09:58:35,993 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:35,993 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:35,993 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35579. timeout=10000 (MILLISECONDS) 09:58:35,993 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35579. Timeout=10000 (MILLISECONDS) 09:58:35,996 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35579} 09:58:35,997 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35579}. Current=null 09:58:35,998 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35579}) => true 09:58:35,998 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35579}. WAITING => ACQUIRED 09:58:35,999 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35579} successfully acquired the lock. 09:58:36,007 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3bef8769] 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35579. timeout=10000 (MILLISECONDS) 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35579. Timeout=10000 (MILLISECONDS) 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35579} 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(64c895d9){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87426] on Test-NodeA-7051 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #11, conn_id=0) 09:58:36,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87426, rsp_expected=true, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 09:58:36,012 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,012 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:36,007 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,013 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87426, rsp_expected=true, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 09:58:36,019 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #11, conn_id=0) 09:58:36,024 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#11 09:58:36,024 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87426 09:58:36,024 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:36,033 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,033 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,033 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,033 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4db2b4fe] 09:58:36,033 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,033 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:36,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,033 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:36,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:36,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2e655da6){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,037 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,038 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2e655da6){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,038 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:36,038 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,040 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,043 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:36,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:36,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87426 to Test-NodeC-52778 09:58:36,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #9, conn_id=2) 09:58:36,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87426, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,049 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,049 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:36,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35579 09:58:36,058 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87426, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,059 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #9, conn_id=2) 09:58:36,062 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#9 09:58:36,065 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,066 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:36,067 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(64c895d9){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,069 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:36,070 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,070 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,156 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:36,158 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35579 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35579. 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35579}. ACQUIRED => RELEASED 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35579}? true 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35579} 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35579}, null) => true 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87418 to Test-NodeA-7051 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #12, conn_id=0) 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87418, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 09:58:36,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35579 09:58:36,167 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,167 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,170 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87418, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 09:58:36,177 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #12, conn_id=0) 09:58:36,177 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#12 09:58:36,177 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,177 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,177 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,177 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1dfaedae] 09:58:36,181 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:36,181 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:36,181 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:36,183 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:36,184 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,184 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,185 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:36,186 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,186 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,186 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:36,187 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87447] on Test-NodeC-52778 09:58:36,187 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #10, conn_id=2) 09:58:36,187 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87447, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,188 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,189 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:36,189 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87447, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,189 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #10, conn_id=2) 09:58:36,190 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#10 09:58:36,191 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87447 09:58:36,192 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:36,194 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,197 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35587. timeout=10000 (MILLISECONDS) 09:58:36,199 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35587. Timeout=10000 (MILLISECONDS) 09:58:36,206 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35587} 09:58:36,206 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35587}. Current=null 09:58:36,206 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35587}) => true 09:58:36,209 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35587}. WAITING => ACQUIRED 09:58:36,209 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35587} successfully acquired the lock. 09:58:36,209 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7579edb] 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35587. timeout=10000 (MILLISECONDS) 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35587. Timeout=10000 (MILLISECONDS) 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35587} 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:36,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5f8ec75f){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,211 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,211 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,212 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,212 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,212 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:36,214 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87455] on Test-NodeB-10318 09:58:36,218 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #4, conn_id=1) 09:58:36,219 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87455, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,219 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,220 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:36,221 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87455, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,222 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #4, conn_id=1) 09:58:36,222 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#4 09:58:36,223 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87455 09:58:36,223 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:36,223 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,223 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,223 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,223 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,223 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@37bdd063] 09:58:36,223 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,223 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:36,224 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,225 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:36,225 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,225 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,225 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:36,225 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4d84a063){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,227 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,228 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4d84a063){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:36,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:36,253 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:36,253 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,253 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,253 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87455 to Test-NodeC-52778 09:58:36,255 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #4, conn_id=1) 09:58:36,255 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87455, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,256 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35587 09:58:36,256 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,256 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:36,256 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87455, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,256 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #4, conn_id=1) 09:58:36,256 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#4 09:58:36,256 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,261 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:36,261 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5f8ec75f){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,261 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:36,266 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,268 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:36,270 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:36,271 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,271 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35587 09:58:36,273 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35587. 09:58:36,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35587}. ACQUIRED => RELEASED 09:58:36,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35587}? true 09:58:36,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35587} 09:58:36,286 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35587}, null) => true 09:58:36,286 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,308 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #12) 09:58:36,308 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=12, conn_id=1, ts=4, TP: [cluster_name=ISPN] 09:58:36,308 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #4) 09:58:36,308 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=4, conn_id=1, ts=5, TP: [cluster_name=ISPN] 09:58:36,308 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:36,291 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,322 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:36,328 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=4, conn_id=1, ts=5, TP: [cluster_name=ISPN] 09:58:36,328 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #4, conn-id=1, ts=5) 09:58:36,320 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87447 to Test-NodeA-7051 09:58:36,327 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:36,333 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=12, conn_id=1, ts=4, TP: [cluster_name=ISPN] 09:58:36,333 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #12, conn-id=1, ts=4) 09:58:36,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #13, conn_id=0) 09:58:36,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87447, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 09:58:36,336 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,336 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35587 09:58:36,337 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87447, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 09:58:36,338 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #13, conn_id=0) 09:58:36,338 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#13 09:58:36,357 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,363 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,368 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,368 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1287f58f] 09:58:36,368 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:36,368 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:36,368 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:36,369 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:36,370 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,371 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,371 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:36,371 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,373 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,374 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:36,374 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87487] on Test-NodeC-52778 09:58:36,374 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #11, conn_id=2) 09:58:36,374 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87487, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,375 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,375 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:36,376 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87487, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,376 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #11, conn_id=2) 09:58:36,376 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#11 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87487 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35593. timeout=10000 (MILLISECONDS) 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35593. Timeout=10000 (MILLISECONDS) 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35593} 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35593}. Current=null 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35593}) => true 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35593}. WAITING => ACQUIRED 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35593} successfully acquired the lock. 09:58:36,378 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3c797708] 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35593. timeout=10000 (MILLISECONDS) 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35593. Timeout=10000 (MILLISECONDS) 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35593} 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5d3ee7bd){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,379 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,379 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,379 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:36,379 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87489] on Test-NodeB-10318 09:58:36,379 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #5, conn_id=1) 09:58:36,379 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87489, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,379 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,379 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:36,379 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87489, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,379 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #5, conn_id=1) 09:58:36,379 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#5 09:58:36,379 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87489 09:58:36,379 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:36,379 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,379 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3359526d] 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(69e9402e){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(69e9402e){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87489 to Test-NodeC-52778 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #5, conn_id=1) 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87489, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,379 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35593 09:58:36,379 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,379 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:36,380 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87489, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,380 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #5, conn_id=1) 09:58:36,380 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#5 09:58:36,380 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,380 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5d3ee7bd){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35593 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35593. 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35593}. ACQUIRED => RELEASED 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35593}? true 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35593} 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35593}, null) => true 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87487 to Test-NodeA-7051 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #14, conn_id=0) 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87487, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 09:58:36,380 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35593 09:58:36,380 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,380 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,380 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87487, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 09:58:36,380 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #14, conn_id=0) 09:58:36,380 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#14 09:58:36,380 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,380 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,380 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,381 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1203462b] 09:58:36,381 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:36,381 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:36,381 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:36,383 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:36,383 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,385 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,385 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:36,386 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,387 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,387 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:36,389 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87492] on Test-NodeC-52778 09:58:36,389 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #12, conn_id=2) 09:58:36,398 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87492, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,398 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,398 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:36,399 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87492, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,400 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #12, conn_id=2) 09:58:36,401 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#12 09:58:36,401 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87492 09:58:36,401 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:36,401 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,404 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35595. timeout=10000 (MILLISECONDS) 09:58:36,404 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35595. Timeout=10000 (MILLISECONDS) 09:58:36,405 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35595} 09:58:36,405 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35595}. Current=null 09:58:36,406 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35595}) => true 09:58:36,424 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35595}. WAITING => ACQUIRED 09:58:36,424 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35595} successfully acquired the lock. 09:58:36,424 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,424 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,424 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,424 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7aab08dc] 09:58:36,426 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,426 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:36,426 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35595. timeout=10000 (MILLISECONDS) 09:58:36,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35595. Timeout=10000 (MILLISECONDS) 09:58:36,438 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35595} 09:58:36,438 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:36,438 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:36,438 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,438 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,438 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:36,438 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(22f10d5){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:36,440 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87499] on Test-NodeA-7051 09:58:36,443 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #15, conn_id=0) 09:58:36,444 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87499, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 09:58:36,444 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,449 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:36,450 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87499, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 09:58:36,450 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #15, conn_id=0) 09:58:36,450 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#15 09:58:36,450 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87499 09:58:36,450 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:36,450 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,451 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@54e274fa] 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(47077770){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(47077770){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87499 to Test-NodeC-52778 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #13, conn_id=2) 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87499, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,451 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35595 09:58:36,451 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,451 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:36,452 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87499, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,452 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #13, conn_id=2) 09:58:36,452 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#13 09:58:36,455 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,456 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:36,456 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(22f10d5){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,457 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35595 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35595. 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35595}. ACQUIRED => RELEASED 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35595}? true 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35595} 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35595}, null) => true 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87492 to Test-NodeA-7051 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #16, conn_id=0) 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87492, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 09:58:36,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35595 09:58:36,467 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,468 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,468 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87492, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 09:58:36,468 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #16, conn_id=0) 09:58:36,468 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#16 09:58:36,468 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,473 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,473 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,476 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7d8e4021] 09:58:36,476 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:36,476 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:36,476 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:35600. timeout=10000 (MILLISECONDS) 09:58:36,476 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35600. Timeout=10000 (MILLISECONDS) 09:58:36,476 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35600} 09:58:36,476 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35600}. Current=null 09:58:36,476 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35600}) => true 09:58:36,476 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35600}. WAITING => ACQUIRED 09:58:36,476 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35600} successfully acquired the lock. 09:58:36,476 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:36,476 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:36,476 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,476 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,476 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:36,476 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6928ca6e){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,476 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,476 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,476 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:36,476 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,476 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,476 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:36,477 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87508] on Test-NodeB-10318 09:58:36,477 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #13, conn_id=1) 09:58:36,477 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87508, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:36,477 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87508, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,477 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #13, conn_id=1) 09:58:36,477 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#13 09:58:36,477 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87508 09:58:36,477 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:36,477 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,477 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,483 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #16) 09:58:36,483 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=16, ts=7, TP: [cluster_name=ISPN] 09:58:36,483 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,483 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:36,483 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=16, ts=7, TP: [cluster_name=ISPN] 09:58:36,483 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #5) 09:58:36,483 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=4, TP: [cluster_name=ISPN] 09:58:36,483 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #16, conn-id=0, ts=7) 09:58:36,479 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,485 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,484 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,487 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:36,484 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #13) 09:58:36,487 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=4, TP: [cluster_name=ISPN] 09:58:36,487 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #5, conn-id=1, ts=4) 09:58:36,487 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=13, conn_id=2, ts=5, TP: [cluster_name=ISPN] 09:58:36,485 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@308ebbb8] 09:58:36,488 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,487 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,488 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:36,488 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=13, conn_id=2, ts=5, TP: [cluster_name=ISPN] 09:58:36,488 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #13, conn-id=2, ts=5) 09:58:36,488 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:36,490 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,492 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:36,500 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,502 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,503 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:36,504 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(58618272){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,505 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,506 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,506 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(58618272){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,506 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:36,506 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,507 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,510 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:36,512 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:36,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,517 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87508 to Test-NodeA-7051 09:58:36,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #15, conn_id=0) 09:58:36,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87508, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 09:58:36,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35600 09:58:36,519 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,519 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,519 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87508, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 09:58:36,520 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #15, conn_id=0) 09:58:36,520 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#15 09:58:36,521 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,521 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:36,522 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6928ca6e){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,523 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:36,525 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,527 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,528 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:36,528 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:36,531 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,534 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:35600 09:58:36,534 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35600. 09:58:36,536 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35600}. ACQUIRED => RELEASED 09:58:36,540 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35600}? true 09:58:36,540 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35600} 09:58:36,540 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35600}, null) => true 09:58:36,540 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,540 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@34926c05] 09:58:36,540 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:36,540 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:36,540 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:36,540 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:36,540 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,540 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,540 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:36,540 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,540 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,551 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:36,551 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87519] on Test-NodeC-52778 09:58:36,553 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #14, conn_id=2) 09:58:36,554 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87519, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,554 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,567 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:36,571 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87519, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,571 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #14, conn_id=2) 09:58:36,572 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#14 09:58:36,572 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87519 09:58:36,572 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35603. timeout=10000 (MILLISECONDS) 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35603. Timeout=10000 (MILLISECONDS) 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35603} 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35603}. Current=null 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35603}) => true 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35603}. WAITING => ACQUIRED 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35603} successfully acquired the lock. 09:58:36,573 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,573 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,573 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,574 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2a46b5c4] 09:58:36,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:36,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35603. timeout=10000 (MILLISECONDS) 09:58:36,583 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35603. Timeout=10000 (MILLISECONDS) 09:58:36,583 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35603} 09:58:36,584 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:36,584 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:36,585 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,585 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,585 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:36,586 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(10f17853){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,586 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,586 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,587 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,588 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,589 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:36,589 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87529] on Test-NodeA-7051 09:58:36,590 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #17, conn_id=0) 09:58:36,590 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87529, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 09:58:36,591 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,591 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:36,591 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87529, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 09:58:36,591 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #17, conn_id=0) 09:58:36,591 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#17 09:58:36,591 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87529 09:58:36,591 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:36,592 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,592 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1fca3e2a] 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1bc6d818){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1bc6d818){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87529 to Test-NodeC-52778 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #15, conn_id=2) 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87529, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,592 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35603 09:58:36,592 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,592 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:36,594 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87529, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,597 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #15, conn_id=2) 09:58:36,598 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#15 09:58:36,598 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,609 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:36,609 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(10f17853){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35603 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35603. 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35603}. ACQUIRED => RELEASED 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35603}? true 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35603} 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35603}, null) => true 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87519 to Test-NodeA-7051 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #18, conn_id=0) 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87519, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 09:58:36,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35603 09:58:36,619 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,622 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,622 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87519, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 09:58:36,622 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #18, conn_id=0) 09:58:36,622 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#18 09:58:36,622 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,624 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,629 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,629 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@490300ff] 09:58:36,629 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:36,629 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:36,629 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:36,629 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:36,629 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,629 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,629 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:36,630 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,630 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,630 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:36,630 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87535] on Test-NodeC-52778 09:58:36,630 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #16, conn_id=2) 09:58:36,630 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87535, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,630 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,630 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87535, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #16, conn_id=2) 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#16 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87535 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35609. timeout=10000 (MILLISECONDS) 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35609. Timeout=10000 (MILLISECONDS) 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35609} 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35609}. Current=null 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35609}) => true 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35609}. WAITING => ACQUIRED 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35609} successfully acquired the lock. 09:58:36,630 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@67bc9f25] 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35609. timeout=10000 (MILLISECONDS) 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35609. Timeout=10000 (MILLISECONDS) 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35609} 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(70b8537d){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87536] on Test-NodeA-7051 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #19, conn_id=0) 09:58:36,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87536, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 09:58:36,632 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,632 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:36,633 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87536, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 09:58:36,633 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #19, conn_id=0) 09:58:36,633 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#19 09:58:36,633 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87536 09:58:36,633 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:36,633 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,633 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5c442a3e] 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(20046a31){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,634 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(20046a31){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,634 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:36,634 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,636 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,636 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:36,637 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:36,637 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,638 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,638 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87536 to Test-NodeC-52778 09:58:36,638 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #17, conn_id=2) 09:58:36,639 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87536, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,639 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,639 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35609 09:58:36,639 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:36,640 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87536, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,640 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #17, conn_id=2) 09:58:36,640 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#17 09:58:36,642 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,642 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:36,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(70b8537d){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:36,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:36,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:36,648 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,648 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35609 09:58:36,649 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35609. 09:58:36,654 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35609}. ACQUIRED => RELEASED 09:58:36,656 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35609}? true 09:58:36,656 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35609} 09:58:36,656 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35609}, null) => true 09:58:36,656 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,656 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,656 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87535 to Test-NodeA-7051 09:58:36,656 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #20, conn_id=0) 09:58:36,656 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87535, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 09:58:36,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35609 09:58:36,661 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,661 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,666 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87535, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 09:58:36,666 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #20, conn_id=0) 09:58:36,666 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#20 09:58:36,667 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,668 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,675 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,675 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3d656bcb] 09:58:36,675 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:36,675 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:36,675 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:36,675 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:36,675 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,675 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,675 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:36,675 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,675 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,675 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:36,676 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87546] on Test-NodeB-10318 09:58:36,677 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #14, conn_id=1) 09:58:36,677 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87546, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,677 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,677 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:36,677 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87546, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,686 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #14, conn_id=1) 09:58:36,686 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#14 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87546 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35611. timeout=10000 (MILLISECONDS) 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35611. Timeout=10000 (MILLISECONDS) 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35611} 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35611}. Current=null 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35611}) => true 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35611}. WAITING => ACQUIRED 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35611} successfully acquired the lock. 09:58:36,687 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,687 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,687 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,687 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21d27929] 09:58:36,687 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,687 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:36,687 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35611. timeout=10000 (MILLISECONDS) 09:58:36,688 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35611. Timeout=10000 (MILLISECONDS) 09:58:36,693 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35611} 09:58:36,693 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:36,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:36,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:36,701 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(219a50d){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,701 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,702 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,702 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,703 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,703 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:36,704 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87555] on Test-NodeC-52778 09:58:36,704 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #6, conn_id=1) 09:58:36,704 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87555, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,704 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,704 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:36,704 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87555, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,704 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #6, conn_id=1) 09:58:36,709 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#6 09:58:36,718 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87555 09:58:36,723 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:36,723 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,729 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1e1f543d] 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(fd66f1){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(fd66f1){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87555 to Test-NodeB-10318 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #6, conn_id=1) 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87555, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35611 09:58:36,735 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,742 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:36,742 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87555, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,742 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #6, conn_id=1) 09:58:36,743 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#6 09:58:36,744 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,746 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,747 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(219a50d){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,747 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:36,753 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,753 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,754 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:36,754 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:36,754 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,755 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35611 09:58:36,755 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35611. 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35611}. ACQUIRED => RELEASED 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35611}? true 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35611} 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35611}, null) => true 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87546 to Test-NodeA-7051 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #16, conn_id=0) 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87546, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 09:58:36,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35611 09:58:36,757 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,757 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,762 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87546, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 09:58:36,771 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #16, conn_id=0) 09:58:36,774 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#16 09:58:36,774 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,774 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:36,778 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,782 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1674a319] 09:58:36,782 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:36,782 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:36,782 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:36,782 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:36,782 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,782 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,782 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:36,782 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,782 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,782 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:36,782 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87568] on Test-NodeC-52778 09:58:36,782 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #18, conn_id=2) 09:58:36,782 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87568, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,782 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,783 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:36,784 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87568, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,784 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #18, conn_id=2) 09:58:36,784 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#18 09:58:36,784 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87568 09:58:36,784 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:36,784 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,785 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35616. timeout=10000 (MILLISECONDS) 09:58:36,785 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35616. Timeout=10000 (MILLISECONDS) 09:58:36,785 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35616} 09:58:36,785 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35616}. Current=null 09:58:36,786 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35616}) => true 09:58:36,787 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35616}. WAITING => ACQUIRED 09:58:36,789 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35616} successfully acquired the lock. 09:58:36,789 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,789 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,789 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,790 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@20fea18c] 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35616. timeout=10000 (MILLISECONDS) 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35616. Timeout=10000 (MILLISECONDS) 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35616} 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1011abb9){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87574] on Test-NodeA-7051 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #21, conn_id=0) 09:58:36,791 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87574, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 09:58:36,791 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,791 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:36,796 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87574, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 09:58:36,796 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #21, conn_id=0) 09:58:36,796 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#21 09:58:36,797 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87574 09:58:36,797 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:36,797 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,797 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6e712b75] 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(43da28bb){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(43da28bb){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87574 to Test-NodeC-52778 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #19, conn_id=2) 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87574, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35616 09:58:36,797 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,797 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:36,800 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87574, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,801 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #19, conn_id=2) 09:58:36,801 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#19 09:58:36,801 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,801 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1011abb9){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35616 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35616. 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35616}. ACQUIRED => RELEASED 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35616}? true 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35616} 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35616}, null) => true 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:36,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87568 to Test-NodeA-7051 09:58:36,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #22, conn_id=0) 09:58:36,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87568, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 09:58:36,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35616 09:58:36,803 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,803 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,806 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87568, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 09:58:36,806 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #22, conn_id=0) 09:58:36,808 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#22 09:58:36,808 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #14) 09:58:36,808 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=14, conn_id=1, ts=6, TP: [cluster_name=ISPN] 09:58:36,808 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #6) 09:58:36,808 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=6, conn_id=1, ts=7, TP: [cluster_name=ISPN] 09:58:36,808 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,809 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:36,809 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=14, conn_id=1, ts=6, TP: [cluster_name=ISPN] 09:58:36,809 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #14, conn-id=1, ts=6) 09:58:36,808 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,813 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,813 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:36,816 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,821 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:36,821 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=6, conn_id=1, ts=7, TP: [cluster_name=ISPN] 09:58:36,822 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #6, conn-id=1, ts=7) 09:58:36,847 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:36,847 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:36,848 DEBUG (testng-Test:[]) [Test] Found key key-to-change1 with primary owner != Test-NodeA-7051, segment 184 09:58:36,848 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6786763e] 09:58:36,848 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:36,848 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:36,848 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change1 for read. Entry=null 09:58:36,848 TRACE (testng-Test:[]) [NonTxDistributionInterceptor] Doing a remote get for key key-to-change1 09:58:36,848 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Perform remote get for key key-to-change1. topologyId=-1, currentTopologyId=5 09:58:36,848 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:36,848 TRACE (testng-Test:[]) [GetKeyValueCommand] Entry not found 09:58:36,848 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:36,849 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:36,849 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_close_iter_invoked * 1 09:58:36,850 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 7f0d23d8-acdf-49dc-a89c-1f5ddd34366f 09:58:36,850 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@7a28a04a[Not completed] to remote execution at node Test-NodeB-10318 09:58:36,850 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f2a316b] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,851 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f2a316b], mode=SYNCHRONOUS, timeout=15000 09:58:36,856 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f2a316b] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:36,858 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87583] on Test-NodeB-10318 09:58:36,858 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #15, conn_id=1) 09:58:36,864 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87583, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,865 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5f05ce24[Not completed] to remote execution at node Test-NodeC-52778 09:58:36,865 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f2a316b] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,865 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f2a316b], mode=SYNCHRONOUS, timeout=15000 09:58:36,865 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f2a316b] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:36,865 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87584] on Test-NodeC-52778 09:58:36,865 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #20, conn_id=2) 09:58:36,865 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,868 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:36,873 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87584, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,873 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87583, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,873 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,873 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:36,874 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87584, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=2, TP: [cluster_name=ISPN] 09:58:36,874 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #20, conn_id=2) 09:58:36,874 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#20 09:58:36,874 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87584 09:58:36,875 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@37a602cb] [sender=Test-NodeA-7051] 09:58:36,875 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:36,875 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,875 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@37a602cb] 09:58:36,875 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 7f0d23d8-acdf-49dc-a89c-1f5ddd34366f 09:58:36,875 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@37a602cb] 09:58:36,875 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87584 to Test-NodeA-7051 09:58:36,875 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #23, conn_id=0) 09:58:36,875 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87584, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 09:58:36,876 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,876 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,876 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87584, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 09:58:36,876 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #23, conn_id=0) 09:58:36,877 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#23 09:58:36,877 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,873 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #15, conn_id=1) 09:58:36,877 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f2a316b] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:36,878 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#15 09:58:36,882 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87583 09:58:36,882 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60bb2a9b] [sender=Test-NodeA-7051] 09:58:36,882 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:36,882 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,882 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60bb2a9b] 09:58:36,882 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 7f0d23d8-acdf-49dc-a89c-1f5ddd34366f 09:58:36,883 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60bb2a9b] 09:58:36,884 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87583 to Test-NodeA-7051 09:58:36,884 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #17, conn_id=0) 09:58:36,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87583, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 09:58:36,886 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,887 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:36,887 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87583, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 09:58:36,887 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #17, conn_id=0) 09:58:36,889 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#17 09:58:36,895 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:36,897 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f2a316b] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:36,965 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are NAKACK2: [HIGHEST_SEQNO, seqno=6], TP: [cluster_name=ISPN] 09:58:36,897 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 7f0d23d8-acdf-49dc-a89c-1f5ddd34366f requests initial state for cache 09:58:36,967 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (39 bytes (195.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:36,968 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (42 bytes) 09:58:36,968 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (42 bytes) 09:58:36,968 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=6], TP: [cluster_name=ISPN] 09:58:36,968 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=6], TP: [cluster_name=ISPN] 09:58:36,968 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@4b65d110] 09:58:36,969 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:36,983 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #17) 09:58:36,993 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=17, ts=8, TP: [cluster_name=ISPN] 09:58:36,993 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #23) 09:58:36,993 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=23, ts=9, TP: [cluster_name=ISPN] 09:58:36,993 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,993 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:36,993 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #6) 09:58:36,993 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=6, conn_id=1, ts=6, TP: [cluster_name=ISPN] 09:58:36,993 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #20) 09:58:36,993 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=20, conn_id=2, ts=7, TP: [cluster_name=ISPN] 09:58:36,993 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=17, ts=8, TP: [cluster_name=ISPN] 09:58:36,993 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,994 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #17, conn-id=0, ts=8) 09:58:36,993 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:36,995 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:36,995 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70510 09:58:36,995 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70510 excluding keys [] 09:58:36,995 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,996 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:36,996 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:36,996 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:36,996 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87600] on Test-NodeB-10318 09:58:36,996 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #16, conn_id=1) 09:58:36,996 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87600, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,994 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:36,997 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:36,997 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,997 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:36,997 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,997 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=23, ts=9, TP: [cluster_name=ISPN] 09:58:36,997 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #23, conn-id=0, ts=9) 09:58:36,998 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87600, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,998 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #16, conn_id=1) 09:58:36,998 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#16 09:58:36,998 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87600 09:58:36,998 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:36,998 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:36,998 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70510 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@2e378f10] 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70510 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70510 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70510 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70510 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70510 09:58:36,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87602] on Test-NodeA-7051 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #18, conn_id=0) 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87602, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 09:58:36,999 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (224 bytes (1120.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:36,999 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (227 bytes) 09:58:36,999 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=150 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87602, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 09:58:36,999 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #18, conn_id=0) 09:58:36,999 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#18 09:58:36,999 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87602 09:58:36,999 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:36,999 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:36,999 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:36,999 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:36,999 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70510 with [] suspected segments. 09:58:36,999 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:36,999 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:36,999 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:36,999 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87602 to Test-NodeB-10318 09:58:36,999 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #17, conn_id=1) 09:58:36,999 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87602, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,999 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:36,999 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:36,999 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87602, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 09:58:36,999 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #17, conn_id=1) 09:58:36,999 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#17 09:58:36,999 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:36,999 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87600 to Test-NodeA-7051 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #19, conn_id=0) 09:58:36,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87600, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 09:58:37,000 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,000 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:37,000 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87600, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 09:58:37,000 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #19, conn_id=0) 09:58:37,000 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#19 09:58:37,000 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:37,000 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:37,000 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70510 excluding keys [] 09:58:37,000 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,000 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:37,000 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:37,000 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,000 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87603] on Test-NodeC-52778 09:58:37,000 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #21, conn_id=2) 09:58:37,000 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87603, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,000 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,000 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:37,000 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87603, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,000 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #21, conn_id=2) 09:58:37,000 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#21 09:58:37,000 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87603 09:58:37,000 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:37,000 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,000 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,000 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:37,000 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70510 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:37,000 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@12e9ffc8] 09:58:37,000 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:37,000 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70510 09:58:37,000 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70510 09:58:37,000 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70510 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70510 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70510 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87604] on Test-NodeA-7051 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #24, conn_id=0) 09:58:37,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87604, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 09:58:36,997 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=6, conn_id=1, ts=6, TP: [cluster_name=ISPN] 09:58:36,997 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:37,002 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #6, conn-id=1, ts=6) 09:58:37,006 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=20, conn_id=2, ts=7, TP: [cluster_name=ISPN] 09:58:37,006 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,007 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:37,007 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87604, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 09:58:37,007 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #24, conn_id=0) 09:58:37,007 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#24 09:58:37,007 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87604 09:58:37,007 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:37,007 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:37,007 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,007 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:37,007 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70510 with [] suspected segments. 09:58:37,007 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:37,009 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #20, conn-id=2, ts=7) 09:58:37,008 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:37,009 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70510 as completed! 09:58:37,009 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:37,009 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87604 to Test-NodeC-52778 09:58:37,010 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #22, conn_id=2) 09:58:37,010 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87604, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,013 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,013 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:37,014 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87604, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,014 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #22, conn_id=2) 09:58:37,016 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#22 09:58:37,018 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:37,018 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:37,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:37,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87603 to Test-NodeA-7051 09:58:37,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #25, conn_id=0) 09:58:37,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87603, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 09:58:37,019 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,019 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:37,021 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87603, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 09:58:37,021 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #25, conn_id=0) 09:58:37,021 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#25 09:58:37,023 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:37,024 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:37,025 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:37,025 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-70510 09:58:37,025 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:37,025 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:37,025 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70510 09:58:37,025 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70510 being completed: true 09:58:37,025 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70510 09:58:37,025 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,025 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:37,025 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:37,025 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:37,026 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:37,027 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:37,031 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:37,032 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:37,032 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:37,032 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:37,032 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:37,033 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:37,033 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:37,034 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:37,034 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:37,034 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:37,035 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:37,035 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:37,035 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:37,036 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:37,037 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:37,038 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,038 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:37,039 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_close_iter_invoked * 1 (available = 1, total = 1) 09:58:37,039 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_close_iter_released * 1 09:58:37,039 TRACE (testng-Test:[]) [CheckPoint] Received event pre_close_iter_invoked * 1 (available = 0, total = 1) 09:58:37,039 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@43e5a20f] 09:58:37,039 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,039 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:37,039 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:37,039 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:58:37,039 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,039 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,039 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:37,039 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,039 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,039 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:37,039 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87612] on Test-NodeB-10318 09:58:37,039 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #18, conn_id=1) 09:58:37,039 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87612, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,039 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (203 bytes (1015.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,039 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (206 bytes) 09:58:37,039 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=129 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87612, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,039 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #18, conn_id=1) 09:58:37,042 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#18 09:58:37,042 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87612 09:58:37,042 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,042 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,046 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:35629. timeout=10000 (MILLISECONDS) 09:58:37,047 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35629. Timeout=10000 (MILLISECONDS) 09:58:37,047 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35629} 09:58:37,047 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35629}. Current=null 09:58:37,050 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35629}) => true 09:58:37,050 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35629}. WAITING => ACQUIRED 09:58:37,050 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35629} successfully acquired the lock. 09:58:37,050 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,050 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,050 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,050 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4daed332] 09:58:37,050 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,050 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:35629. timeout=10000 (MILLISECONDS) 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35629. Timeout=10000 (MILLISECONDS) 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35629} 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7d653aab){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87619] on Test-NodeA-7051 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #20, conn_id=0) 09:58:37,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87619, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 09:58:37,051 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (203 bytes (1015.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,054 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (206 bytes) 09:58:37,054 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=129 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87619, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 09:58:37,054 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #20, conn_id=0) 09:58:37,055 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#20 09:58:37,055 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87619 09:58:37,055 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:37,055 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,055 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,055 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,056 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,056 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5a29e17b] 09:58:37,057 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,057 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:37,062 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:37,062 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:37,067 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,069 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,069 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:37,070 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(48249575){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,070 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,074 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,074 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(48249575){key=key-to-change1, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,074 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:37,075 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,075 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,075 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:37,076 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=new-value} in container 09:58:37,076 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,078 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87619 to Test-NodeB-10318 09:58:37,078 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #19, conn_id=1) 09:58:37,079 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87619, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,079 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,079 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35629 09:58:37,079 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:37,080 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87619, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,080 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #19, conn_id=1) 09:58:37,080 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#19 09:58:37,080 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,081 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:37,083 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7d653aab){key=key-to-change1, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,087 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:37,088 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,088 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,090 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:37,090 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=new-value} in container 09:58:37,090 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, key=key-to-change1, value=new-value, oldValue=null, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:58:37,090 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5ce20b67[Not completed] to remote execution at node Test-NodeA-7051 09:58:37,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@7066ab26] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@7066ab26], mode=SYNCHRONOUS, timeout=15000 09:58:37,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@7066ab26] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:37,093 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87630] on Test-NodeA-7051 09:58:37,094 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #21, conn_id=0) 09:58:37,094 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87630, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 09:58:37,095 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (373 bytes (1865.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,095 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (376 bytes) 09:58:37,100 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=299 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87630, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 09:58:37,100 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #21, conn_id=0) 09:58:37,100 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#21 09:58:37,100 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87630 09:58:37,101 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@5c45af6b] [sender=Test-NodeB-10318] 09:58:37,106 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:37,110 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,110 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@5c45af6b] 09:58:37,110 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_CREATED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=new-value, oldValue=null, transaction=null, retryCommand=false, origin=Test-NodeB-10318}], notifying cluster listener with id 7f0d23d8-acdf-49dc-a89c-1f5ddd34366f 09:58:37,110 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@5c45af6b] 09:58:37,110 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87630 to Test-NodeB-10318 09:58:37,110 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #20, conn_id=1) 09:58:37,110 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87630, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,112 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,113 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:37,113 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87630, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,122 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #20, conn_id=1) 09:58:37,128 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#20 09:58:37,128 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,128 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@7066ab26] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:37,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,137 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:35629 09:58:37,137 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35629. 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35629}. ACQUIRED => RELEASED 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35629}? true 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35629} 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35629}, null) => true 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87612 to Test-NodeA-7051 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #22, conn_id=0) 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87612, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 09:58:37,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:35629 09:58:37,168 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,169 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,187 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87612, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 09:58:37,187 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #22, conn_id=0) 09:58:37,187 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#22 09:58:37,187 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,187 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:37,187 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,193 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_close_iter_released * 999999999 (available = 999999999, total = 999999999) 09:58:37,194 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_close_iter_released * 1 (available = 999999998, total = 999999999) 09:58:37,194 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=new-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:37,196 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 7f0d23d8-acdf-49dc-a89c-1f5ddd34366f initial state for cache completed 09:58:37,197 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:37,199 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:37,199 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:37,199 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@7d93b4d3[Not completed] to self 09:58:37,199 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@781bc0a6[Not completed] to remote execution at node Test-NodeB-10318 09:58:37,199 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@57590099] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,199 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@57590099], mode=SYNCHRONOUS, timeout=15000 09:58:37,199 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@57590099] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:37,199 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87645] on Test-NodeB-10318 09:58:37,199 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #21, conn_id=1) 09:58:37,199 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87645, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,200 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,200 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:37,200 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@78c4fe0[Not completed] to remote execution at node Test-NodeC-52778 09:58:37,200 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@57590099] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,200 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@57590099], mode=SYNCHRONOUS, timeout=15000 09:58:37,200 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@57590099] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,200 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87646] on Test-NodeC-52778 09:58:37,200 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #23, conn_id=2) 09:58:37,200 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87646, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,200 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,200 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:37,200 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87645, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,201 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #21, conn_id=1) 09:58:37,201 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#21 09:58:37,201 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87645 09:58:37,201 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5d076272] [sender=Test-NodeA-7051] 09:58:37,201 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:37,201 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5d076272] 09:58:37,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 7f0d23d8-acdf-49dc-a89c-1f5ddd34366f 09:58:37,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5d076272] 09:58:37,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87645 to Test-NodeA-7051 09:58:37,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #23, conn_id=0) 09:58:37,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87645, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 09:58:37,201 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,201 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,201 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87645, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 09:58:37,201 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #23, conn_id=0) 09:58:37,201 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#23 09:58:37,201 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,201 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@57590099] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:37,204 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87646, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,204 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #23, conn_id=2) 09:58:37,204 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#23 09:58:37,205 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87646 09:58:37,205 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@45be5940] [sender=Test-NodeA-7051] 09:58:37,205 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:37,205 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,205 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@45be5940] 09:58:37,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 7f0d23d8-acdf-49dc-a89c-1f5ddd34366f 09:58:37,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@45be5940] 09:58:37,215 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87646 to Test-NodeA-7051 09:58:37,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #26, conn_id=0) 09:58:37,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87646, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 09:58:37,227 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,227 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,234 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87646, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 09:58:37,238 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #26, conn_id=0) 09:58:37,238 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#26 09:58:37,238 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,239 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@57590099] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:37,244 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganAndCompletedSegmentValueNonOwnerClustered 09:58:37,244 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:37,248 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:37,248 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:37,248 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:37,248 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:37,248 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:37,248 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:37,248 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:37,248 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:37,248 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:37,248 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:37,248 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:37,249 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:37,249 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:37,249 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganAndCompletedSegmentValueOwnerClustered 09:58:37,249 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@41e251a3] 09:58:37,249 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,249 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:37,249 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:37,249 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:37,249 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,249 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,249 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:37,249 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,249 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,249 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:37,249 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87651] on Test-NodeB-10318 09:58:37,249 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #22, conn_id=1) 09:58:37,249 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87651, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,249 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,249 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:37,250 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87651, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,257 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #22, conn_id=1) 09:58:37,257 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#22 09:58:37,257 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87651 09:58:37,257 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,257 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,257 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35635. timeout=10000 (MILLISECONDS) 09:58:37,257 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35635. Timeout=10000 (MILLISECONDS) 09:58:37,259 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35635} 09:58:37,262 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35635}. Current=null 09:58:37,262 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35635}) => true 09:58:37,263 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35635}. WAITING => ACQUIRED 09:58:37,264 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35635} successfully acquired the lock. 09:58:37,265 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,265 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,266 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,266 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@495d718f] 09:58:37,266 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:37,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35635. timeout=10000 (MILLISECONDS) 09:58:37,271 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35635. Timeout=10000 (MILLISECONDS) 09:58:37,271 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35635} 09:58:37,271 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:37,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:37,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,275 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,280 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:37,287 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7eea0ec0){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,287 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,287 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,287 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,287 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,291 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87658] on Test-NodeC-52778 09:58:37,299 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #7, conn_id=1) 09:58:37,301 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87658, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,304 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,304 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:37,305 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87658, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,305 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #7, conn_id=1) 09:58:37,309 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#7 09:58:37,316 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87658 09:58:37,316 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:37,316 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,322 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #22) 09:58:37,322 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=22, conn_id=1, ts=8, TP: [cluster_name=ISPN] 09:58:37,322 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,322 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:37,322 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=22, conn_id=1, ts=8, TP: [cluster_name=ISPN] 09:58:37,322 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #22, conn-id=1, ts=8) 09:58:37,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@138d3ce9] 09:58:37,316 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,323 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,323 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:37,323 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:37,331 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:37,331 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,332 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,333 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:37,333 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(46247b8e){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,333 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(46247b8e){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:37,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:37,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:37,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87658 to Test-NodeB-10318 09:58:37,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #7, conn_id=1) 09:58:37,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87658, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35635 09:58:37,339 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,340 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:37,340 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87658, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,340 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #7, conn_id=1) 09:58:37,350 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#7 09:58:37,350 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,351 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:37,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7eea0ec0){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,354 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:37,354 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,354 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,360 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:37,360 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:37,363 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,364 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35635 09:58:37,367 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35635. 09:58:37,367 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35635}. ACQUIRED => RELEASED 09:58:37,368 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35635}? true 09:58:37,368 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35635} 09:58:37,368 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35635}, null) => true 09:58:37,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:37,371 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,372 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87651 to Test-NodeA-7051 09:58:37,372 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #24, conn_id=0) 09:58:37,372 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87651, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 09:58:37,372 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35635 09:58:37,372 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,372 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,372 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87651, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 09:58:37,377 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #24, conn_id=0) 09:58:37,377 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#24 09:58:37,377 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,378 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:37,379 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,380 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5a5ddc82] 09:58:37,380 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,380 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:37,380 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:37,380 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:37,381 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,381 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,382 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:37,382 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,382 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,383 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,385 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87680] on Test-NodeC-52778 09:58:37,389 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #24, conn_id=2) 09:58:37,390 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87680, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,390 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,390 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:37,390 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87680, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,390 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #24, conn_id=2) 09:58:37,391 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#24 09:58:37,391 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87680 09:58:37,392 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,394 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,395 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35645. timeout=10000 (MILLISECONDS) 09:58:37,395 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35645. Timeout=10000 (MILLISECONDS) 09:58:37,397 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35645} 09:58:37,398 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35645}. Current=null 09:58:37,399 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35645}) => true 09:58:37,407 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35645}. WAITING => ACQUIRED 09:58:37,407 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35645} successfully acquired the lock. 09:58:37,412 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,412 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,412 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@76549e80] 09:58:37,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:37,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35645. timeout=10000 (MILLISECONDS) 09:58:37,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35645. Timeout=10000 (MILLISECONDS) 09:58:37,415 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35645} 09:58:37,415 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:37,415 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:37,416 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,416 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:37,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7b81f13a){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,418 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,420 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,421 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,421 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:37,421 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87685] on Test-NodeA-7051 09:58:37,421 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #27, conn_id=0) 09:58:37,421 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87685, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 09:58:37,421 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,421 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:37,422 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87685, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 09:58:37,422 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #27, conn_id=0) 09:58:37,423 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#27 09:58:37,425 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87685 09:58:37,425 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:37,426 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,429 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,429 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,429 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,436 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6146989a] 09:58:37,436 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,436 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:37,436 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:37,445 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:37,445 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,446 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,459 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:37,459 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7e444ec4){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,460 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,460 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,462 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7e444ec4){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,463 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:37,463 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,464 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,464 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:37,465 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:37,465 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,465 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,467 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87685 to Test-NodeC-52778 09:58:37,470 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #25, conn_id=2) 09:58:37,470 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87685, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,470 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35645 09:58:37,470 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,470 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:37,471 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87685, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,472 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #25, conn_id=2) 09:58:37,472 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#25 09:58:37,472 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,472 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:37,478 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7b81f13a){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,482 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:37,482 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,482 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,482 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:37,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:37,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,489 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35645 09:58:37,492 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35645. 09:58:37,492 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35645}. ACQUIRED => RELEASED 09:58:37,494 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35645}? true 09:58:37,493 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #7) 09:58:37,495 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=7, conn_id=1, ts=8, TP: [cluster_name=ISPN] 09:58:37,495 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,495 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:37,495 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #25) 09:58:37,495 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35645} 09:58:37,495 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35645}, null) => true 09:58:37,496 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:37,496 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,496 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #24) 09:58:37,496 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=24, ts=10, TP: [cluster_name=ISPN] 09:58:37,496 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #27) 09:58:37,496 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=27, ts=11, TP: [cluster_name=ISPN] 09:58:37,496 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,495 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=7, conn_id=1, ts=8, TP: [cluster_name=ISPN] 09:58:37,497 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #7, conn-id=1, ts=8) 09:58:37,497 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=25, conn_id=2, ts=9, TP: [cluster_name=ISPN] 09:58:37,497 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:37,497 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87680 to Test-NodeA-7051 09:58:37,497 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,500 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=24, ts=10, TP: [cluster_name=ISPN] 09:58:37,500 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #24, conn-id=0, ts=10) 09:58:37,500 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,500 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:37,501 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=25, conn_id=2, ts=9, TP: [cluster_name=ISPN] 09:58:37,500 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #28, conn_id=0) 09:58:37,501 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87680, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 09:58:37,501 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,501 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35645 09:58:37,501 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #25, conn-id=2, ts=9) 09:58:37,500 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:37,502 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=27, ts=11, TP: [cluster_name=ISPN] 09:58:37,502 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #27, conn-id=0, ts=11) 09:58:37,502 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,502 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87680, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 09:58:37,504 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #28, conn_id=0) 09:58:37,505 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#28 09:58:37,506 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,506 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:37,506 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,507 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7d899a83] 09:58:37,516 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,516 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:37,516 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:37,516 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:37,516 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,516 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,516 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:37,516 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,516 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,516 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,516 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87707] on Test-NodeC-52778 09:58:37,516 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #26, conn_id=2) 09:58:37,516 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87707, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,516 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,516 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:37,518 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87707, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,518 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #26, conn_id=2) 09:58:37,518 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#26 09:58:37,518 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87707 09:58:37,518 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,522 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,522 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35652. timeout=10000 (MILLISECONDS) 09:58:37,525 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35652. Timeout=10000 (MILLISECONDS) 09:58:37,525 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35652} 09:58:37,536 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35652}. Current=null 09:58:37,536 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35652}) => true 09:58:37,537 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35652}. WAITING => ACQUIRED 09:58:37,537 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35652} successfully acquired the lock. 09:58:37,537 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,537 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,537 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,537 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@48084404] 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35652. timeout=10000 (MILLISECONDS) 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35652. Timeout=10000 (MILLISECONDS) 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35652} 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(fbee5b3){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87712] on Test-NodeB-10318 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #8, conn_id=1) 09:58:37,541 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87712, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,541 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,542 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:37,542 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87712, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,542 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #8, conn_id=1) 09:58:37,542 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#8 09:58:37,550 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87712 09:58:37,550 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:37,557 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,557 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,557 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,557 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2a93d06e] 09:58:37,557 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,562 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,562 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:37,562 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:37,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:37,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,566 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,567 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:37,568 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(f2d84f9){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,569 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,569 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,569 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(f2d84f9){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,569 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:37,571 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,571 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,573 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:37,575 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:37,576 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,576 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,576 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87712 to Test-NodeC-52778 09:58:37,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #8, conn_id=1) 09:58:37,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87712, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35652 09:58:37,580 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,585 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:37,585 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87712, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,585 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #8, conn_id=1) 09:58:37,586 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#8 09:58:37,587 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,590 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:37,590 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(fbee5b3){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,594 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:37,594 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,594 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,594 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:37,596 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:37,598 TRACE (Timer-2,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:37,596 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,602 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35652 09:58:37,602 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35652. 09:58:37,602 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35652}. ACQUIRED => RELEASED 09:58:37,601 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:37,602 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,602 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:37,603 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:37,603 TRACE (INT-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeB-10318: mine: Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:37,604 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35652}? true 09:58:37,604 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35652} 09:58:37,604 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35652}, null) => true 09:58:37,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:37,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87707 to Test-NodeA-7051 09:58:37,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #29, conn_id=0) 09:58:37,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87707, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 09:58:37,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35652 09:58:37,618 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,618 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,618 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87707, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 09:58:37,618 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #29, conn_id=0) 09:58:37,618 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#29 09:58:37,618 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,618 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:37,618 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,618 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@68592ab0] 09:58:37,619 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,619 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:37,619 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:37,619 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:37,619 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,619 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,619 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:37,619 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,619 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,619 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,619 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87733] on Test-NodeC-52778 09:58:37,619 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #27, conn_id=2) 09:58:37,619 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87733, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,619 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,619 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:37,619 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87733, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,620 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #27, conn_id=2) 09:58:37,620 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#27 09:58:37,630 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87733 09:58:37,630 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35658. timeout=10000 (MILLISECONDS) 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35658. Timeout=10000 (MILLISECONDS) 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35658} 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35658}. Current=null 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35658}) => true 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35658}. WAITING => ACQUIRED 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35658} successfully acquired the lock. 09:58:37,636 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,639 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,639 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3a606163] 09:58:37,639 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,640 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:37,644 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35658. timeout=10000 (MILLISECONDS) 09:58:37,644 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35658. Timeout=10000 (MILLISECONDS) 09:58:37,645 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35658} 09:58:37,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:37,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(637cf71){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:37,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87738] on Test-NodeB-10318 09:58:37,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #9, conn_id=1) 09:58:37,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87738, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,651 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,651 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:37,695 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87738, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,703 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #9, conn_id=1) 09:58:37,703 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#9 09:58:37,703 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87738 09:58:37,703 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:37,712 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,712 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@10d549e7] 09:58:37,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:37,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:37,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:37,713 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,713 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,713 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:37,713 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(41f0da1e){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,713 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,714 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(41f0da1e){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:37,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:37,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:37,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87738 to Test-NodeC-52778 09:58:37,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #9, conn_id=1) 09:58:37,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87738, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35658 09:58:37,717 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,717 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:37,717 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87738, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,719 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #9, conn_id=1) 09:58:37,720 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#9 09:58:37,720 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,724 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:37,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(637cf71){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:37,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:37,730 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:37,730 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,730 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35658 09:58:37,730 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35658. 09:58:37,731 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35658}. ACQUIRED => RELEASED 09:58:37,731 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35658}? true 09:58:37,731 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35658} 09:58:37,731 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35658}, null) => true 09:58:37,731 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:37,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87733 to Test-NodeA-7051 09:58:37,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #30, conn_id=0) 09:58:37,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87733, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 09:58:37,737 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35658 09:58:37,737 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,741 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,741 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87733, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 09:58:37,741 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #30, conn_id=0) 09:58:37,741 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#30 09:58:37,743 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,746 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:37,746 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,747 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@49226207] 09:58:37,750 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,751 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:37,751 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:37,751 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:37,751 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,751 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,751 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:37,751 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,751 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,751 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,751 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87753] on Test-NodeC-52778 09:58:37,751 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #28, conn_id=2) 09:58:37,751 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87753, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,751 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,751 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:37,751 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87753, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,755 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #28, conn_id=2) 09:58:37,755 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#28 09:58:37,760 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87753 09:58:37,763 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,763 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,763 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35662. timeout=10000 (MILLISECONDS) 09:58:37,764 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35662. Timeout=10000 (MILLISECONDS) 09:58:37,764 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35662} 09:58:37,764 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35662}. Current=null 09:58:37,764 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35662}) => true 09:58:37,764 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35662}. WAITING => ACQUIRED 09:58:37,764 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35662} successfully acquired the lock. 09:58:37,764 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2b356bbe] 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35662. timeout=10000 (MILLISECONDS) 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35662. Timeout=10000 (MILLISECONDS) 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35662} 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:37,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:37,769 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,769 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,769 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:37,769 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(46f6ba1b){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,769 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,770 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:37,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87757] on Test-NodeA-7051 09:58:37,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #31, conn_id=0) 09:58:37,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87757, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 09:58:37,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:37,780 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87757, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 09:58:37,783 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #31, conn_id=0) 09:58:37,783 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#31 09:58:37,784 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87757 09:58:37,784 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:37,784 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,786 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,787 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,786 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,787 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6bf35a4e] 09:58:37,787 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,788 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:37,788 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:37,790 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:37,790 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,792 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,792 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:37,792 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(710f578){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(710f578){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87757 to Test-NodeC-52778 09:58:37,793 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #29, conn_id=2) 09:58:37,794 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87757, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,794 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35662 09:58:37,794 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,794 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:37,794 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87757, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,794 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #29, conn_id=2) 09:58:37,794 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#29 09:58:37,794 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,796 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:37,796 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(46f6ba1b){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,796 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:37,799 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:37,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:37,802 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,802 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35662 09:58:37,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35662. 09:58:37,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35662}. ACQUIRED => RELEASED 09:58:37,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35662}? true 09:58:37,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35662} 09:58:37,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35662}, null) => true 09:58:37,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:37,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87753 to Test-NodeA-7051 09:58:37,806 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #32, conn_id=0) 09:58:37,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87753, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 09:58:37,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35662 09:58:37,808 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,808 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,808 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87753, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 09:58:37,808 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #32, conn_id=0) 09:58:37,808 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#32 09:58:37,808 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,808 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:37,808 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,814 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6114953] 09:58:37,816 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,822 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #9) 09:58:37,822 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=9, conn_id=1, ts=9, TP: [cluster_name=ISPN] 09:58:37,822 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,822 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:37,822 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=9, conn_id=1, ts=9, TP: [cluster_name=ISPN] 09:58:37,822 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #9, conn-id=1, ts=9) 09:58:37,817 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:37,826 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:35666. timeout=10000 (MILLISECONDS) 09:58:37,826 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35666. Timeout=10000 (MILLISECONDS) 09:58:37,828 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35666} 09:58:37,828 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35666}. Current=null 09:58:37,828 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35666}) => true 09:58:37,830 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35666}. WAITING => ACQUIRED 09:58:37,830 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35666} successfully acquired the lock. 09:58:37,830 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:37,831 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:37,831 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,831 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,831 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:37,831 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(ef753b6){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,831 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,831 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,831 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:37,831 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,832 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,835 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:37,835 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87773] on Test-NodeB-10318 09:58:37,835 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #23, conn_id=1) 09:58:37,835 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87773, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,835 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,839 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:37,839 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87773, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 09:58:37,843 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #23, conn_id=1) 09:58:37,843 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#23 09:58:37,844 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87773 09:58:37,846 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,846 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,846 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,846 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,847 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,847 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@75d472ee] 09:58:37,848 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,850 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:37,850 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:37,854 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:37,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,857 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:37,861 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(16bd2ae1){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,862 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,862 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,863 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(16bd2ae1){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,863 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:37,864 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,864 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:37,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:37,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87773 to Test-NodeA-7051 09:58:37,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #25, conn_id=0) 09:58:37,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87773, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 09:58:37,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35666 09:58:37,865 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,867 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,869 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87773, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 09:58:37,870 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #25, conn_id=0) 09:58:37,870 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#25 09:58:37,874 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,874 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:37,874 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(ef753b6){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,875 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:37,875 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,877 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,879 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:37,881 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:37,882 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,882 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:35666 09:58:37,883 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35666. 09:58:37,883 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35666}. ACQUIRED => RELEASED 09:58:37,883 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35666}? true 09:58:37,884 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35666} 09:58:37,890 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35666}, null) => true 09:58:37,890 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:37,890 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@39eb0321] 09:58:37,890 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,890 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:37,890 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:37,890 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:37,890 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,890 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,890 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:37,890 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,890 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,890 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,890 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87790] on Test-NodeC-52778 09:58:37,890 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #30, conn_id=2) 09:58:37,890 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87790, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,890 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,892 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:37,894 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87790, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,894 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #30, conn_id=2) 09:58:37,894 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#30 09:58:37,894 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87790 09:58:37,894 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,895 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,895 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35671. timeout=10000 (MILLISECONDS) 09:58:37,895 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35671. Timeout=10000 (MILLISECONDS) 09:58:37,896 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35671} 09:58:37,896 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35671}. Current=null 09:58:37,897 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35671}) => true 09:58:37,897 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35671}. WAITING => ACQUIRED 09:58:37,897 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35671} successfully acquired the lock. 09:58:37,897 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,897 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,899 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,900 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@26e3bb59] 09:58:37,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:37,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35671. timeout=10000 (MILLISECONDS) 09:58:37,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35671. Timeout=10000 (MILLISECONDS) 09:58:37,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35671} 09:58:37,905 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:37,906 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:37,907 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,907 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:37,911 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7e789a80){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,913 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,914 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,914 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,920 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,920 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:37,921 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87798] on Test-NodeA-7051 09:58:37,921 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #33, conn_id=0) 09:58:37,921 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87798, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 09:58:37,921 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,921 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:37,922 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87798, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 09:58:37,922 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #33, conn_id=0) 09:58:37,923 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#33 09:58:37,924 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87798 09:58:37,925 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:37,925 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,926 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,926 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,925 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,926 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@52472f48] 09:58:37,928 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,928 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:37,929 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:37,929 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:37,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(e2979aa){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(e2979aa){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87798 to Test-NodeC-52778 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #31, conn_id=2) 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87798, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35671 09:58:37,935 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,935 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:37,935 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87798, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,935 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #31, conn_id=2) 09:58:37,935 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#31 09:58:37,936 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,936 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:37,937 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7e789a80){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:37,938 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:37,938 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:37,938 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:37,939 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:37,939 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:37,940 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,940 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35671 09:58:37,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35671. 09:58:37,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35671}. ACQUIRED => RELEASED 09:58:37,945 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35671}? true 09:58:37,945 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35671} 09:58:37,948 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35671}, null) => true 09:58:37,950 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:37,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87790 to Test-NodeA-7051 09:58:37,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #34, conn_id=0) 09:58:37,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87790, rsp_expected=true, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 09:58:37,955 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:37,955 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35671 09:58:37,956 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:37,957 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87790, rsp_expected=true, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 09:58:37,958 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #34, conn_id=0) 09:58:37,958 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#34 09:58:37,960 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:37,960 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:37,960 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:37,961 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@568cc7a1] 09:58:37,963 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:37,964 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:37,964 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:37,967 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:37,967 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:37,967 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:37,969 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:37,972 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:37,972 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:37,973 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:37,974 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87811] on Test-NodeC-52778 09:58:37,974 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #32, conn_id=2) 09:58:37,979 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87811, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,981 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:37,983 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:37,983 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87811, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=2, TP: [cluster_name=ISPN] 09:58:37,983 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #32, conn_id=2) 09:58:37,984 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#32 09:58:37,984 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87811 09:58:37,984 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:37,985 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:37,988 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35677. timeout=10000 (MILLISECONDS) 09:58:37,988 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35677. Timeout=10000 (MILLISECONDS) 09:58:37,989 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35677} 09:58:37,989 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35677}. Current=null 09:58:37,991 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35677}) => true 09:58:37,992 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35677}. WAITING => ACQUIRED 09:58:37,993 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35677} successfully acquired the lock. 09:58:37,993 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:37,993 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:37,993 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:37,995 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1b17f8c6] 09:58:37,997 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #9) 09:58:37,997 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:37,997 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:37,997 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=9, conn_id=1, ts=10, TP: [cluster_name=ISPN] 09:58:37,997 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #25) 09:58:38,001 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=25, ts=12, TP: [cluster_name=ISPN] 09:58:38,001 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #34) 09:58:38,001 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=34, ts=13, TP: [cluster_name=ISPN] 09:58:38,001 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,997 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:37,997 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #32) 09:58:38,003 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:38,004 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35677. timeout=10000 (MILLISECONDS) 09:58:38,004 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35677. Timeout=10000 (MILLISECONDS) 09:58:38,003 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=9, conn_id=1, ts=10, TP: [cluster_name=ISPN] 09:58:38,004 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #9, conn-id=1, ts=10) 09:58:38,003 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:38,005 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,005 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:38,004 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=32, conn_id=2, ts=11, TP: [cluster_name=ISPN] 09:58:38,004 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35677} 09:58:38,007 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,007 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:38,008 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,008 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:38,008 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=32, conn_id=2, ts=11, TP: [cluster_name=ISPN] 09:58:38,008 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #32, conn-id=2, ts=11) 09:58:38,005 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=34, ts=13, TP: [cluster_name=ISPN] 09:58:38,005 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=25, ts=12, TP: [cluster_name=ISPN] 09:58:38,009 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #34, conn-id=0, ts=13) 09:58:38,009 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #25, conn-id=0, ts=12) 09:58:38,007 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,010 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,010 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:38,010 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1c87f65){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,010 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,010 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,013 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,013 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:38,013 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87821] on Test-NodeA-7051 09:58:38,013 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #35, conn_id=0) 09:58:38,013 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87821, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 09:58:38,014 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,016 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:38,017 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87821, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 09:58:38,017 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #35, conn_id=0) 09:58:38,017 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#35 09:58:38,017 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87821 09:58:38,017 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:38,017 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,017 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,017 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,019 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,019 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7f79730b] 09:58:38,021 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,022 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:38,024 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,025 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:38,025 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,025 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,025 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7fc2f2a9){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7fc2f2a9){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,026 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87821 to Test-NodeC-52778 09:58:38,027 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #33, conn_id=2) 09:58:38,028 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87821, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,029 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35677 09:58:38,029 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,029 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:38,029 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87821, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,029 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #33, conn_id=2) 09:58:38,029 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#33 09:58:38,030 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,030 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:38,030 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1c87f65){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,031 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:38,031 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,031 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,035 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:38,036 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:38,036 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,036 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35677 09:58:38,036 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35677. 09:58:38,037 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35677}. ACQUIRED => RELEASED 09:58:38,037 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35677}? true 09:58:38,038 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35677} 09:58:38,039 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35677}, null) => true 09:58:38,039 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,040 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,040 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87811 to Test-NodeA-7051 09:58:38,043 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #36, conn_id=0) 09:58:38,043 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87811, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 09:58:38,043 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,044 TRACE (Timer-3,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:38,044 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:38,044 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,044 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:38,044 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:38,043 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,043 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35677 09:58:38,044 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87811, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 09:58:38,045 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #36, conn_id=0) 09:58:38,045 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#36 09:58:38,045 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,046 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,046 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,046 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@347ca49] 09:58:38,047 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,048 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:38,049 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:38,049 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:38,049 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,050 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,050 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:38,051 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,051 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,051 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,052 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87831] on Test-NodeB-10318 09:58:38,052 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #24, conn_id=1) 09:58:38,053 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87831, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,053 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,054 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:38,054 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87831, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,054 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #24, conn_id=1) 09:58:38,055 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#24 09:58:38,056 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87831 09:58:38,056 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,057 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,057 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35682. timeout=10000 (MILLISECONDS) 09:58:38,058 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35682. Timeout=10000 (MILLISECONDS) 09:58:38,059 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35682} 09:58:38,059 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35682}. Current=null 09:58:38,059 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35682}) => true 09:58:38,059 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35682}. WAITING => ACQUIRED 09:58:38,059 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35682} successfully acquired the lock. 09:58:38,060 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,060 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,061 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,061 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2c1dd3a0] 09:58:38,061 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,061 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:38,062 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35682. timeout=10000 (MILLISECONDS) 09:58:38,062 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35682. Timeout=10000 (MILLISECONDS) 09:58:38,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35682} 09:58:38,064 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,064 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:38,064 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,069 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:38,070 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6b7acc17){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,077 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,077 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,077 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,077 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,079 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87836] on Test-NodeC-52778 09:58:38,085 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #10, conn_id=1) 09:58:38,086 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87836, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,087 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,087 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,087 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87836, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,087 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #10, conn_id=1) 09:58:38,087 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#10 09:58:38,087 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87836 09:58:38,087 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:38,088 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,088 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,088 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,089 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,089 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3f4f851d] 09:58:38,089 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,090 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:38,090 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,092 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:38,092 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,092 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,093 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:38,093 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5b80aed0){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,093 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,094 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,094 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5b80aed0){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,095 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:38,095 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,095 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,096 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:38,096 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:38,099 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,099 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,100 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87836 to Test-NodeB-10318 09:58:38,100 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #10, conn_id=1) 09:58:38,100 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87836, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,102 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,102 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:38,102 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87836, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35682 09:58:38,103 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #10, conn_id=1) 09:58:38,105 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#10 09:58:38,105 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,105 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6b7acc17){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35682 09:58:38,106 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35682. 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35682}. ACQUIRED => RELEASED 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35682}? true 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35682} 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35682}, null) => true 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87831 to Test-NodeA-7051 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #26, conn_id=0) 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87831, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 09:58:38,107 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35682 09:58:38,107 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,107 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,107 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87831, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 09:58:38,107 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #26, conn_id=0) 09:58:38,107 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#26 09:58:38,107 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,110 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,110 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,110 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1e9e0d63] 09:58:38,110 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,110 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:38,110 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:38,111 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:38,111 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,112 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,113 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:38,113 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,113 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,114 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,114 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87847] on Test-NodeC-52778 09:58:38,115 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #34, conn_id=2) 09:58:38,121 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87847, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,132 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,132 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,132 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87847, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,132 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #34, conn_id=2) 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#34 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87847 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35687. timeout=10000 (MILLISECONDS) 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35687. Timeout=10000 (MILLISECONDS) 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35687} 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35687}. Current=null 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35687}) => true 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35687}. WAITING => ACQUIRED 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35687} successfully acquired the lock. 09:58:38,134 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,134 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,134 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,134 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7606b702] 09:58:38,134 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,134 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:38,134 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35687. timeout=10000 (MILLISECONDS) 09:58:38,134 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35687. Timeout=10000 (MILLISECONDS) 09:58:38,134 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35687} 09:58:38,136 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,136 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:38,136 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,211 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,211 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:38,211 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(8554913){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,212 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,212 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,212 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,214 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,215 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:38,215 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87857] on Test-NodeA-7051 09:58:38,216 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #37, conn_id=0) 09:58:38,217 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87857, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 09:58:38,218 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,219 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:38,221 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87857, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 09:58:38,221 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #37, conn_id=0) 09:58:38,221 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#37 09:58:38,222 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87857 09:58:38,222 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:38,223 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,223 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,223 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,224 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,224 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1494af76] 09:58:38,224 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,224 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:38,224 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,224 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(51356067){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(51356067){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87857 to Test-NodeC-52778 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #35, conn_id=2) 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87857, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,225 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35687 09:58:38,225 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,225 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:38,229 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87857, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,229 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #35, conn_id=2) 09:58:38,229 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#35 09:58:38,229 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,230 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:38,230 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(8554913){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,230 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:38,230 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:38,233 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:38,234 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,234 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35687 09:58:38,235 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35687. 09:58:38,236 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35687}. ACQUIRED => RELEASED 09:58:38,236 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35687}? true 09:58:38,236 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35687} 09:58:38,237 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35687}, null) => true 09:58:38,237 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,238 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,238 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87847 to Test-NodeA-7051 09:58:38,238 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #38, conn_id=0) 09:58:38,244 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87847, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 09:58:38,248 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,255 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,255 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87847, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 09:58:38,248 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35687 09:58:38,256 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #38, conn_id=0) 09:58:38,256 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#38 09:58:38,256 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,256 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,256 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,256 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:38,256 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:38,257 DEBUG (testng-Test:[]) [Test] Found key key-to-change0 with primary owner Test-NodeA-7051, segment 51 09:58:38,257 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@a5c72f0] 09:58:38,257 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,257 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,260 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change0 for read. Entry=null 09:58:38,261 TRACE (testng-Test:[]) [NonTxDistributionInterceptor] Doing a remote get for key key-to-change0 09:58:38,263 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Perform remote get for key key-to-change0. topologyId=-1, currentTopologyId=5 09:58:38,263 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:38,264 TRACE (testng-Test:[]) [GetKeyValueCommand] Entry not found 09:58:38,264 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:38,267 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_close_iter_invoked * 1 09:58:38,267 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:38,268 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 3c256084-4761-4e1b-86f0-adf38233aa3c 09:58:38,268 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@7ad4c406[Not completed] to remote execution at node Test-NodeB-10318 09:58:38,268 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7d950d2d] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,268 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7d950d2d], mode=SYNCHRONOUS, timeout=15000 09:58:38,268 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7d950d2d] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,268 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87870] on Test-NodeB-10318 09:58:38,268 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #25, conn_id=1) 09:58:38,268 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87870, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,268 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,268 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:38,268 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87870, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,268 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@28c4d556[Not completed] to remote execution at node Test-NodeC-52778 09:58:38,274 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7d950d2d] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,274 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7d950d2d], mode=SYNCHRONOUS, timeout=15000 09:58:38,274 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #25, conn_id=1) 09:58:38,274 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7d950d2d] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,275 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#25 09:58:38,275 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87873] on Test-NodeC-52778 09:58:38,276 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #36, conn_id=2) 09:58:38,276 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87873, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,276 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87870 09:58:38,276 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,278 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4d1e9f63] [sender=Test-NodeA-7051] 09:58:38,278 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:38,280 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4d1e9f63] 09:58:38,278 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:38,280 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,280 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87873, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,280 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 3c256084-4761-4e1b-86f0-adf38233aa3c 09:58:38,281 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4d1e9f63] 09:58:38,281 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87870 to Test-NodeA-7051 09:58:38,281 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #27, conn_id=0) 09:58:38,281 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #36, conn_id=2) 09:58:38,281 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87870, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 09:58:38,282 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#36 09:58:38,283 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87873 09:58:38,283 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,286 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,286 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4d9e51a5] [sender=Test-NodeA-7051] 09:58:38,286 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:38,286 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4d9e51a5] 09:58:38,286 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87870, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 09:58:38,286 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,287 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #27, conn_id=0) 09:58:38,287 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 3c256084-4761-4e1b-86f0-adf38233aa3c 09:58:38,287 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4d9e51a5] 09:58:38,287 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87873 to Test-NodeA-7051 09:58:38,287 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #39, conn_id=0) 09:58:38,287 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87873, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 09:58:38,287 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#27 09:58:38,288 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,288 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,288 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,288 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87873, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 09:58:38,289 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7d950d2d] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,289 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #39, conn_id=0) 09:58:38,289 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#39 09:58:38,290 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,290 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7d950d2d] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,290 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 3c256084-4761-4e1b-86f0-adf38233aa3c requests initial state for cache 09:58:38,291 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@3b3369a2] 09:58:38,292 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:38,295 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:38,295 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70511 09:58:38,297 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70511 excluding keys [] 09:58:38,297 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,298 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:38,304 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:38,304 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,304 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87888] on Test-NodeB-10318 09:58:38,305 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #26, conn_id=1) 09:58:38,306 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87888, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,306 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,306 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:38,306 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87888, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,307 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #26, conn_id=1) 09:58:38,307 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#26 09:58:38,307 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87888 09:58:38,307 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:38,307 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,309 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:38,309 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,310 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70511 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:38,310 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@6ca0a356] 09:58:38,312 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:38,312 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70511 09:58:38,312 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70511 09:58:38,312 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70511 09:58:38,312 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:38,313 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70511 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:38,313 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70511 09:58:38,314 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,314 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:38,314 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:38,315 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87893] on Test-NodeA-7051 09:58:38,315 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #28, conn_id=0) 09:58:38,316 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87893, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 09:58:38,316 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (224 bytes (1120.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,317 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (227 bytes) 09:58:38,317 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=150 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87893, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 09:58:38,318 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #28, conn_id=0) 09:58:38,318 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#28 09:58:38,319 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87893 09:58:38,320 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:38,320 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:38,320 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,320 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:38,321 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70511 with [] suspected segments. 09:58:38,322 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:38,322 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:38,323 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:38,323 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87893 to Test-NodeB-10318 09:58:38,323 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #27, conn_id=1) 09:58:38,323 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87893, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,322 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #26) 09:58:38,323 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=26, conn_id=1, ts=10, TP: [cluster_name=ISPN] 09:58:38,323 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #10) 09:58:38,323 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,323 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=10, conn_id=1, ts=11, TP: [cluster_name=ISPN] 09:58:38,323 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,327 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:38,324 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:38,328 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=26, conn_id=1, ts=10, TP: [cluster_name=ISPN] 09:58:38,328 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #26, conn-id=1, ts=10) 09:58:38,328 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,328 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:38,329 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, conn_id=1, ts=11, TP: [cluster_name=ISPN] 09:58:38,329 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #10, conn-id=1, ts=11) 09:58:38,328 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87893, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,329 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #27, conn_id=1) 09:58:38,329 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#27 09:58:38,329 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:38,329 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:38,330 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:38,331 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87888 to Test-NodeA-7051 09:58:38,331 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #29, conn_id=0) 09:58:38,331 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87888, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 09:58:38,340 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,340 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:38,341 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87888, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 09:58:38,342 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #29, conn_id=0) 09:58:38,342 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#29 09:58:38,342 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:38,342 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,345 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70511 excluding keys [] 09:58:38,345 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,345 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:38,345 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:38,345 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,345 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87902] on Test-NodeC-52778 09:58:38,345 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #37, conn_id=2) 09:58:38,345 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87902, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,346 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,346 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:38,347 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87902, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,348 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #37, conn_id=2) 09:58:38,349 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#37 09:58:38,349 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87902 09:58:38,350 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:38,350 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,351 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,351 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:38,352 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70511 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:38,352 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@6c27b314] 09:58:38,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:38,356 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70511 09:58:38,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70511 09:58:38,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70511 09:58:38,362 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:38,363 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70511 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:38,363 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70511 09:58:38,364 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,364 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:38,365 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:38,365 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87908] on Test-NodeA-7051 09:58:38,367 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #40, conn_id=0) 09:58:38,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87908, rsp_expected=true, UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 09:58:38,369 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,369 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:38,369 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87908, rsp_expected=true, UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 09:58:38,370 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #40, conn_id=0) 09:58:38,371 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#40 09:58:38,371 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87908 09:58:38,371 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:38,373 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:38,373 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:38,373 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,374 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70511 with [] suspected segments. 09:58:38,374 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:38,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:38,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70511 as completed! 09:58:38,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:38,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87908 to Test-NodeC-52778 09:58:38,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #38, conn_id=2) 09:58:38,381 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87908, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,382 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,385 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:38,386 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87908, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,387 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #38, conn_id=2) 09:58:38,388 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#38 09:58:38,388 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:38,391 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:38,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:38,393 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87902 to Test-NodeA-7051 09:58:38,393 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #41, conn_id=0) 09:58:38,394 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87902, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 09:58:38,395 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,395 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,395 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:38,396 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87902, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 09:58:38,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 129 09:58:38,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 130 09:58:38,396 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #41, conn_id=0) 09:58:38,398 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#41 09:58:38,398 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:38,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 131 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 4 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 132 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 133 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 135 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 8 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 10 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 139 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 14 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 15 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 16 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 18 09:58:38,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 19 09:58:38,398 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,400 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 147 09:58:38,400 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:38,401 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-70511 09:58:38,400 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 148 09:58:38,402 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 21 09:58:38,402 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:38,404 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:38,402 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 151 09:58:38,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 153 09:58:38,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 30 09:58:38,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 158 09:58:38,406 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70511 09:58:38,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 31 09:58:38,406 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 159 09:58:38,406 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 164 09:58:38,406 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 40 09:58:38,406 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70511 being completed: true 09:58:38,407 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70511 09:58:38,407 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 41 09:58:38,407 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 45 09:58:38,409 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 47 09:58:38,409 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 180 09:58:38,409 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 181 09:58:38,409 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 60 09:58:38,410 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 63 09:58:38,410 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 67 09:58:38,410 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 195 09:58:38,411 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 69 09:58:38,411 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 201 09:58:38,412 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 74 09:58:38,413 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 203 09:58:38,414 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 76 09:58:38,415 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 205 09:58:38,418 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 78 09:58:38,418 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 81 09:58:38,421 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 82 09:58:38,422 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 210 09:58:38,422 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 83 09:58:38,423 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 85 09:58:38,423 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 86 09:58:38,424 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 90 09:58:38,424 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 219 09:58:38,425 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 93 09:58:38,425 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 94 09:58:38,425 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 222 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 96 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 224 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 98 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 99 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 227 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 228 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 103 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 107 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 108 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 236 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 239 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 240 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 113 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 241 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 245 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 119 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 120 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 249 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 122 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 124 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 253 09:58:38,426 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:38,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:38,426 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,426 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,427 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,427 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,427 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,427 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,427 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:38,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:38,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:38,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:38,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:38,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:38,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:38,427 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:38,427 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_close_iter_invoked * 1 (available = 1, total = 1) 09:58:38,427 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_close_iter_released * 1 09:58:38,427 TRACE (testng-Test:[]) [CheckPoint] Received event pre_close_iter_invoked * 1 (available = 0, total = 1) 09:58:38,427 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@49014d3a] 09:58:38,427 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,427 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:58:38,428 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:35709. timeout=10000 (MILLISECONDS) 09:58:38,428 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35709. Timeout=10000 (MILLISECONDS) 09:58:38,428 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35709} 09:58:38,428 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35709}. Current=null 09:58:38,428 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35709}) => true 09:58:38,428 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35709}. WAITING => ACQUIRED 09:58:38,428 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35709} successfully acquired the lock. 09:58:38,428 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:38,428 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:38,428 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,428 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,428 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:38,429 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3beb67ad){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,429 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,429 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,429 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:38,429 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,429 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,430 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,431 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87925] on Test-NodeB-10318 09:58:38,431 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #28, conn_id=1) 09:58:38,431 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87925, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,431 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (203 bytes (1015.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,431 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (206 bytes) 09:58:38,432 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=129 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87925, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,432 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #28, conn_id=1) 09:58:38,432 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#28 09:58:38,432 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87925 09:58:38,432 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,432 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,432 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,432 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,432 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,432 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7575a8f9] 09:58:38,433 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,433 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:58:38,433 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,434 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:38,435 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,435 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,436 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:38,445 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5364a377){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,446 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,446 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,448 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5364a377){key=key-to-change0, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,448 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:38,448 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,448 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:38,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=new-value} in container 09:58:38,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87925 to Test-NodeA-7051 09:58:38,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #30, conn_id=0) 09:58:38,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87925, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 09:58:38,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35709 09:58:38,451 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,451 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,457 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87925, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 09:58:38,457 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #30, conn_id=0) 09:58:38,457 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#30 09:58:38,460 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,461 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,462 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3beb67ad){key=key-to-change0, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,462 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:38,462 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,462 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,462 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:38,463 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=new-value} in container 09:58:38,463 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,465 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:35709 09:58:38,465 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35709. 09:58:38,465 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35709}. ACQUIRED => RELEASED 09:58:38,465 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35709}? true 09:58:38,465 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35709} 09:58:38,466 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35709}, null) => true 09:58:38,466 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,466 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_close_iter_released * 999999999 (available = 999999999, total = 999999999) 09:58:38,466 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_close_iter_released * 1 (available = 999999998, total = 999999999) 09:58:38,468 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change0, value=new-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:38,468 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 3c256084-4761-4e1b-86f0-adf38233aa3c initial state for cache completed 09:58:38,469 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:38,469 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:38,469 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:38,470 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@5b424e94[Not completed] to self 09:58:38,470 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@42058080[Not completed] to remote execution at node Test-NodeB-10318 09:58:38,470 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@42605e83] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,470 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@42605e83], mode=SYNCHRONOUS, timeout=15000 09:58:38,471 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@42605e83] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,471 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87936] on Test-NodeB-10318 09:58:38,471 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #29, conn_id=1) 09:58:38,471 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87936, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,472 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,472 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:38,472 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@2c300f4c[Not completed] to remote execution at node Test-NodeC-52778 09:58:38,472 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@42605e83] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,472 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87936, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,474 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #29, conn_id=1) 09:58:38,474 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@42605e83], mode=SYNCHRONOUS, timeout=15000 09:58:38,474 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@42605e83] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,478 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87938] on Test-NodeC-52778 09:58:38,478 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #39, conn_id=2) 09:58:38,478 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87938, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,479 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,474 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#29 09:58:38,479 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87936 09:58:38,479 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:38,479 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7bb3d0f8] [sender=Test-NodeA-7051] 09:58:38,481 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:38,481 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,481 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7bb3d0f8] 09:58:38,482 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 3c256084-4761-4e1b-86f0-adf38233aa3c 09:58:38,482 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7bb3d0f8] 09:58:38,483 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87936 to Test-NodeA-7051 09:58:38,483 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #31, conn_id=0) 09:58:38,483 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87936, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 09:58:38,483 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,483 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,488 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87938, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,496 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87936, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 09:58:38,496 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #31, conn_id=0) 09:58:38,496 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#31 09:58:38,488 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #39, conn_id=2) 09:58:38,497 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#39 09:58:38,497 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,497 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@42605e83] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,497 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87938 09:58:38,501 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@513e87a6] [sender=Test-NodeA-7051] 09:58:38,505 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #31) 09:58:38,505 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=31, ts=14, TP: [cluster_name=ISPN] 09:58:38,510 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,504 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:38,510 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,510 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@513e87a6] 09:58:38,510 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:38,510 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #41) 09:58:38,508 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #10) 09:58:38,510 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=31, ts=14, TP: [cluster_name=ISPN] 09:58:38,510 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=41, ts=15, TP: [cluster_name=ISPN] 09:58:38,510 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 3c256084-4761-4e1b-86f0-adf38233aa3c 09:58:38,521 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@513e87a6] 09:58:38,521 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87938 to Test-NodeA-7051 09:58:38,521 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #42, conn_id=0) 09:58:38,521 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87938, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 09:58:38,521 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,521 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,521 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #31, conn-id=0, ts=14) 09:58:38,521 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87938, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 09:58:38,522 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #42, conn_id=0) 09:58:38,520 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=10, conn_id=1, ts=12, TP: [cluster_name=ISPN] 09:58:38,522 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #39) 09:58:38,522 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,522 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:38,522 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=39, conn_id=2, ts=13, TP: [cluster_name=ISPN] 09:58:38,522 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#42 09:58:38,524 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, conn_id=1, ts=12, TP: [cluster_name=ISPN] 09:58:38,521 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,524 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:38,524 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=41, ts=15, TP: [cluster_name=ISPN] 09:58:38,525 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #41, conn-id=0, ts=15) 09:58:38,524 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #10, conn-id=1, ts=12) 09:58:38,523 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,526 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:38,525 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,527 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@42605e83] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,527 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganAndCompletedSegmentValueOwnerClustered 09:58:38,528 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=39, conn_id=2, ts=13, TP: [cluster_name=ISPN] 09:58:38,529 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:38,529 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #39, conn-id=2, ts=13) 09:58:38,530 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:38,531 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:38,531 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:38,534 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:38,535 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:38,535 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:38,535 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:38,535 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:38,535 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:38,535 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:38,535 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:38,535 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:38,538 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:38,539 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered 09:58:38,539 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7629fa4d] 09:58:38,539 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,539 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:38,540 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:38,540 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:38,540 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,540 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,540 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:38,540 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,540 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,541 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,541 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87952] on Test-NodeB-10318 09:58:38,541 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #30, conn_id=1) 09:58:38,543 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87952, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,546 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,546 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:38,546 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87952, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,546 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #30, conn_id=1) 09:58:38,546 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#30 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87952 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35718. timeout=10000 (MILLISECONDS) 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35718. Timeout=10000 (MILLISECONDS) 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35718} 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35718}. Current=null 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35718}) => true 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35718}. WAITING => ACQUIRED 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35718} successfully acquired the lock. 09:58:38,548 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7f009beb] 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35718. timeout=10000 (MILLISECONDS) 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35718. Timeout=10000 (MILLISECONDS) 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35718} 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(608d3a12){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,549 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,549 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,549 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,549 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,549 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=87953] on Test-NodeC-52778 09:58:38,549 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #11, conn_id=1) 09:58:38,549 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87953, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,549 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,549 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,549 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87953, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,549 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #11, conn_id=1) 09:58:38,554 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#11 09:58:38,554 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87953 09:58:38,554 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:38,554 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,554 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,554 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,554 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@27c24d32] 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7628cb7f){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7628cb7f){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,557 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,558 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87953 to Test-NodeB-10318 09:58:38,558 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #11, conn_id=1) 09:58:38,558 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87953, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,558 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35718 09:58:38,558 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,558 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:38,558 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87953, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,558 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #11, conn_id=1) 09:58:38,558 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#11 09:58:38,558 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,558 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,558 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(608d3a12){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,559 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:38,559 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,559 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35718 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35718. 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35718}. ACQUIRED => RELEASED 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35718}? true 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35718} 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35718}, null) => true 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87952 to Test-NodeA-7051 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #32, conn_id=0) 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87952, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 09:58:38,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35718 09:58:38,563 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,563 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,563 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87952, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 09:58:38,563 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #32, conn_id=0) 09:58:38,569 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#32 09:58:38,570 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,570 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,570 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,570 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6c0e30b] 09:58:38,570 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,570 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:38,570 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:38,570 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:38,570 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,570 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,570 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:38,570 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,570 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,581 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,581 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87961] on Test-NodeC-52778 09:58:38,582 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #40, conn_id=2) 09:58:38,582 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87961, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,583 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,583 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,583 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87961, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,584 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #40, conn_id=2) 09:58:38,584 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#40 09:58:38,585 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87961 09:58:38,585 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,585 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,585 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35721. timeout=10000 (MILLISECONDS) 09:58:38,586 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35721. Timeout=10000 (MILLISECONDS) 09:58:38,586 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35721} 09:58:38,586 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35721}. Current=null 09:58:38,586 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35721}) => true 09:58:38,586 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35721}. WAITING => ACQUIRED 09:58:38,586 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35721} successfully acquired the lock. 09:58:38,587 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,587 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,587 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,587 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@bf91e2] 09:58:38,588 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,588 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:38,588 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35721. timeout=10000 (MILLISECONDS) 09:58:38,588 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35721. Timeout=10000 (MILLISECONDS) 09:58:38,591 TRACE (Timer-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:38,591 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:38,591 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:58:38,591 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:38,591 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeA-7051: mine: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:38,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35721} 09:58:38,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:38,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:38,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(b4d37e6){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:38,593 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87966] on Test-NodeA-7051 09:58:38,593 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #43, conn_id=0) 09:58:38,593 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87966, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 09:58:38,593 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,593 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:38,593 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87966, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 09:58:38,593 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #43, conn_id=0) 09:58:38,595 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#43 09:58:38,595 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87966 09:58:38,595 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:38,595 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,595 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3c01b01c] 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(46cdd9a3){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(46cdd9a3){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 87966 to Test-NodeC-52778 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #41, conn_id=2) 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87966, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,595 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35721 09:58:38,595 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,595 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:38,595 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87966, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,595 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #41, conn_id=2) 09:58:38,595 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#41 09:58:38,596 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,596 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:38,596 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(b4d37e6){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,604 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35721 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35721. 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35721}. ACQUIRED => RELEASED 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35721}? true 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35721} 09:58:38,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35721}, null) => true 09:58:38,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87961 to Test-NodeA-7051 09:58:38,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #44, conn_id=0) 09:58:38,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87961, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 09:58:38,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35721 09:58:38,606 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,606 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,606 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87961, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 09:58:38,606 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #44, conn_id=0) 09:58:38,606 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#44 09:58:38,606 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,606 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,606 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,606 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@79da9c51] 09:58:38,606 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,606 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:38,606 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:38,606 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:38,606 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,606 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,606 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:38,606 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,606 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,606 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,606 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87968] on Test-NodeC-52778 09:58:38,606 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #42, conn_id=2) 09:58:38,606 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87968, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,606 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,607 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,609 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87968, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,617 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #42, conn_id=2) 09:58:38,617 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#42 09:58:38,617 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87968 09:58:38,619 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,619 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,619 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35724. timeout=10000 (MILLISECONDS) 09:58:38,620 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35724. Timeout=10000 (MILLISECONDS) 09:58:38,620 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35724} 09:58:38,620 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35724}. Current=null 09:58:38,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35724}) => true 09:58:38,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35724}. WAITING => ACQUIRED 09:58:38,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35724} successfully acquired the lock. 09:58:38,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,621 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,623 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,623 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3a995012] 09:58:38,627 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,628 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:38,629 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35724. timeout=10000 (MILLISECONDS) 09:58:38,629 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35724. Timeout=10000 (MILLISECONDS) 09:58:38,629 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35724} 09:58:38,630 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,631 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2de82e09){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87976] on Test-NodeB-10318 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #12, conn_id=1) 09:58:38,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87976, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,634 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,634 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:38,634 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87976, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,635 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #12, conn_id=1) 09:58:38,635 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#12 09:58:38,635 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87976 09:58:38,635 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:38,635 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,635 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@20d3a3ac] 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1ecc3081){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1ecc3081){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87976 to Test-NodeC-52778 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #12, conn_id=1) 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87976, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,635 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35724 09:58:38,635 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,635 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:38,636 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87976, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,636 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #12, conn_id=1) 09:58:38,636 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#12 09:58:38,636 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,636 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2de82e09){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35724 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35724. 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35724}. ACQUIRED => RELEASED 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35724}? true 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35724} 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35724}, null) => true 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87968 to Test-NodeA-7051 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #45, conn_id=0) 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87968, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster_name=ISPN] 09:58:38,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35724 09:58:38,636 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,636 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,636 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87968, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster_name=ISPN] 09:58:38,636 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #45, conn_id=0) 09:58:38,636 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#45 09:58:38,636 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,637 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,637 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,637 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@43b58a8d] 09:58:38,637 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,637 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:38,637 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:38,637 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:38,637 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,637 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,637 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:38,638 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,647 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,647 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,647 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=87980] on Test-NodeC-52778 09:58:38,647 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #43, conn_id=2) 09:58:38,647 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87980, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,647 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,649 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,649 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87980, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,651 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #43, conn_id=2) 09:58:38,651 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#43 09:58:38,654 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87980 09:58:38,654 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,657 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,659 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35728. timeout=10000 (MILLISECONDS) 09:58:38,659 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35728. Timeout=10000 (MILLISECONDS) 09:58:38,664 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35728} 09:58:38,664 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35728}. Current=null 09:58:38,664 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35728}) => true 09:58:38,664 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35728}. WAITING => ACQUIRED 09:58:38,666 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35728} successfully acquired the lock. 09:58:38,666 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,666 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,667 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,667 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2261154e] 09:58:38,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:38,673 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35728. timeout=10000 (MILLISECONDS) 09:58:38,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35728. Timeout=10000 (MILLISECONDS) 09:58:38,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35728} 09:58:38,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:38,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,692 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,694 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:38,696 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(59e42c03){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,698 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,698 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,703 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,704 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=87996] on Test-NodeB-10318 09:58:38,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #13, conn_id=1) 09:58:38,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87996, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,718 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,722 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:38,726 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=87996, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,726 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #13, conn_id=1) 09:58:38,729 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#13 09:58:38,729 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 87996 09:58:38,729 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:38,733 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,737 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,738 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,738 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@e072b58] 09:58:38,739 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,741 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:38,741 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,741 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:38,743 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,745 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,745 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:38,746 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1eacf94b){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,746 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,747 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,747 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1eacf94b){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,748 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:38,748 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,750 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,750 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:38,750 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:38,752 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,752 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,754 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 87996 to Test-NodeC-52778 09:58:38,754 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #13, conn_id=1) 09:58:38,757 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87996, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,760 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35728 09:58:38,760 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,763 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:38,764 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87996, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,764 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #13, conn_id=1) 09:58:38,764 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#13 09:58:38,764 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,764 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(59e42c03){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:38,765 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:38,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:38,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,770 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35728 09:58:38,770 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35728. 09:58:38,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35728}. ACQUIRED => RELEASED 09:58:38,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35728}? true 09:58:38,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35728} 09:58:38,772 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35728}, null) => true 09:58:38,772 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,772 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,775 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 87980 to Test-NodeA-7051 09:58:38,776 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #46, conn_id=0) 09:58:38,777 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87980, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster_name=ISPN] 09:58:38,777 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,778 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,777 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35728 09:58:38,779 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=87980, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster_name=ISPN] 09:58:38,779 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #46, conn_id=0) 09:58:38,779 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#46 09:58:38,780 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,782 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,782 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,782 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6a4dbcb9] 09:58:38,783 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,784 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:38,786 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:38,793 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:38,793 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,794 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,794 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:38,795 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,795 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,795 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,796 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88022] on Test-NodeC-52778 09:58:38,798 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #44, conn_id=2) 09:58:38,798 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88022, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,800 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,800 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,801 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88022, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,802 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #44, conn_id=2) 09:58:38,802 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#44 09:58:38,802 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88022 09:58:38,803 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,804 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,806 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35739. timeout=10000 (MILLISECONDS) 09:58:38,806 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35739. Timeout=10000 (MILLISECONDS) 09:58:38,806 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35739} 09:58:38,806 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35739}. Current=null 09:58:38,806 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35739}) => true 09:58:38,807 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35739}. WAITING => ACQUIRED 09:58:38,807 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35739} successfully acquired the lock. 09:58:38,807 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,807 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3c345509] 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35739. timeout=10000 (MILLISECONDS) 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35739. Timeout=10000 (MILLISECONDS) 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35739} 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(14c310dd){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88027] on Test-NodeA-7051 09:58:38,808 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #47, conn_id=0) 09:58:38,809 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88027, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster_name=ISPN] 09:58:38,809 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,811 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:38,812 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88027, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster_name=ISPN] 09:58:38,812 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #47, conn_id=0) 09:58:38,812 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#47 09:58:38,812 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88027 09:58:38,812 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:38,812 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,812 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,812 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,813 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,814 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@264e0ab3] 09:58:38,814 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,816 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:38,816 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:38,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:38,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(51e87e05){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,819 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,821 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,821 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(51e87e05){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,823 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:38,824 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #30) 09:58:38,827 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=30, conn_id=1, ts=12, TP: [cluster_name=ISPN] 09:58:38,824 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,827 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,827 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #13) 09:58:38,827 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=13, conn_id=1, ts=13, TP: [cluster_name=ISPN] 09:58:38,827 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:38,829 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:38,830 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:38,830 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=30, conn_id=1, ts=12, TP: [cluster_name=ISPN] 09:58:38,829 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,831 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:38,831 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,831 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=13, conn_id=1, ts=13, TP: [cluster_name=ISPN] 09:58:38,831 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #13, conn-id=1, ts=13) 09:58:38,831 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,831 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #30, conn-id=1, ts=12) 09:58:38,833 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88027 to Test-NodeC-52778 09:58:38,833 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #45, conn_id=2) 09:58:38,835 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88027, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,836 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35739 09:58:38,836 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,836 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:38,836 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88027, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,837 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #45, conn_id=2) 09:58:38,838 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#45 09:58:38,838 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,839 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:38,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(14c310dd){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:38,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,840 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,840 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:38,840 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:38,841 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,844 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35739 09:58:38,844 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35739. 09:58:38,844 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35739}. ACQUIRED => RELEASED 09:58:38,844 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35739}? true 09:58:38,845 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35739} 09:58:38,845 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35739}, null) => true 09:58:38,846 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,846 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,847 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88022 to Test-NodeA-7051 09:58:38,847 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #48, conn_id=0) 09:58:38,847 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88022, rsp_expected=true, UNICAST3: DATA, seqno=48, TP: [cluster_name=ISPN] 09:58:38,847 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35739 09:58:38,847 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,847 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,898 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88022, rsp_expected=true, UNICAST3: DATA, seqno=48, TP: [cluster_name=ISPN] 09:58:38,901 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #48, conn_id=0) 09:58:38,902 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#48 09:58:38,902 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,903 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,903 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,903 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@711700d] 09:58:38,905 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,906 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:38,906 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:35748. timeout=10000 (MILLISECONDS) 09:58:38,906 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35748. Timeout=10000 (MILLISECONDS) 09:58:38,906 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35748} 09:58:38,906 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35748}. Current=null 09:58:38,907 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35748}) => true 09:58:38,907 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35748}. WAITING => ACQUIRED 09:58:38,908 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35748} successfully acquired the lock. 09:58:38,909 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:38,909 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:38,911 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,911 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,912 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:38,912 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(27f93557){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,912 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,913 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,913 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:38,913 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,913 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,913 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:38,913 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88046] on Test-NodeB-10318 09:58:38,913 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #31, conn_id=1) 09:58:38,913 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88046, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,914 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:38,914 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:38,915 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88046, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=1, TP: [cluster_name=ISPN] 09:58:38,916 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #31, conn_id=1) 09:58:38,917 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#31 09:58:38,917 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88046 09:58:38,917 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,918 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,919 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,921 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@23dff7f1] 09:58:38,921 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,923 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:38,923 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,923 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:38,923 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,924 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:38,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5ce89333){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,929 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5ce89333){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,930 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:38,930 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,930 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,930 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:38,930 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:38,931 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,931 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,931 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88046 to Test-NodeA-7051 09:58:38,932 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #33, conn_id=0) 09:58:38,932 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88046, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 09:58:38,934 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,934 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35748 09:58:38,937 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,941 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88046, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 09:58:38,947 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #33, conn_id=0) 09:58:38,947 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#33 09:58:38,947 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,947 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:38,950 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(27f93557){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,951 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:38,951 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,951 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,951 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:38,951 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:38,951 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,951 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:35748 09:58:38,951 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35748. 09:58:38,951 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35748}. ACQUIRED => RELEASED 09:58:38,952 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35748}? true 09:58:38,952 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35748} 09:58:38,952 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35748}, null) => true 09:58:38,952 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,952 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1e5bdc8a] 09:58:38,952 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,952 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:38,952 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:38,952 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:38,952 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,952 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,952 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:38,952 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,952 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,952 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,952 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88055] on Test-NodeC-52778 09:58:38,952 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #46, conn_id=2) 09:58:38,952 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88055, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,952 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,952 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,953 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88055, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,953 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #46, conn_id=2) 09:58:38,955 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#46 09:58:38,955 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88055 09:58:38,957 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,957 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,957 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35753. timeout=10000 (MILLISECONDS) 09:58:38,957 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35753. Timeout=10000 (MILLISECONDS) 09:58:38,966 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35753} 09:58:38,966 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35753}. Current=null 09:58:38,966 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35753}) => true 09:58:38,966 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35753}. WAITING => ACQUIRED 09:58:38,966 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35753} successfully acquired the lock. 09:58:38,966 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4e5b0f6c] 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35753. timeout=10000 (MILLISECONDS) 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35753. Timeout=10000 (MILLISECONDS) 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35753} 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7be69a7b){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88059] on Test-NodeA-7051 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #49, conn_id=0) 09:58:38,966 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88059, rsp_expected=true, UNICAST3: DATA, seqno=49, TP: [cluster_name=ISPN] 09:58:38,966 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,966 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:38,967 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88059, rsp_expected=true, UNICAST3: DATA, seqno=49, TP: [cluster_name=ISPN] 09:58:38,967 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #49, conn_id=0) 09:58:38,967 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#49 09:58:38,967 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88059 09:58:38,967 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:38,967 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,967 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6058a574] 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(48f0681d){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(48f0681d){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88059 to Test-NodeC-52778 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #47, conn_id=2) 09:58:38,967 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88059, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,968 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35753 09:58:38,968 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,968 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:38,968 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88059, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,968 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #47, conn_id=2) 09:58:38,968 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#47 09:58:38,968 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,968 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7be69a7b){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35753 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35753. 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35753}. ACQUIRED => RELEASED 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35753}? true 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35753} 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35753}, null) => true 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88055 to Test-NodeA-7051 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #50, conn_id=0) 09:58:38,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88055, rsp_expected=true, UNICAST3: DATA, seqno=50, TP: [cluster_name=ISPN] 09:58:38,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35753 09:58:38,972 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,972 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:38,972 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88055, rsp_expected=true, UNICAST3: DATA, seqno=50, TP: [cluster_name=ISPN] 09:58:38,973 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #50, conn_id=0) 09:58:38,973 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#50 09:58:38,973 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:38,973 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:38,973 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,974 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6f7b3429] 09:58:38,974 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:38,975 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:38,977 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:38,983 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:38,984 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,985 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,985 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:38,986 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,986 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,986 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:38,986 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88062] on Test-NodeC-52778 09:58:38,988 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #48, conn_id=2) 09:58:38,989 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88062, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,989 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:38,990 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:38,990 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88062, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #48, conn_id=2) 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#48 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88062 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35755. timeout=10000 (MILLISECONDS) 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35755. Timeout=10000 (MILLISECONDS) 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35755} 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35755}. Current=null 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35755}) => true 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35755}. WAITING => ACQUIRED 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35755} successfully acquired the lock. 09:58:38,991 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@77a22d61] 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35755. timeout=10000 (MILLISECONDS) 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35755. Timeout=10000 (MILLISECONDS) 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35755} 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:38,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1c4e7b51){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:38,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:38,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:38,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88064] on Test-NodeA-7051 09:58:38,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #51, conn_id=0) 09:58:38,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88064, rsp_expected=true, UNICAST3: DATA, seqno=51, TP: [cluster_name=ISPN] 09:58:38,992 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:38,992 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:38,992 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88064, rsp_expected=true, UNICAST3: DATA, seqno=51, TP: [cluster_name=ISPN] 09:58:38,992 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #51, conn_id=0) 09:58:38,992 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#51 09:58:38,992 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88064 09:58:38,992 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:38,992 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:38,992 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1ebdf822] 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(cb7a5a6){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(cb7a5a6){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:38,992 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:38,995 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:38,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:38,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:38,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:38,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:38,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:38,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88064 to Test-NodeC-52778 09:58:38,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #49, conn_id=2) 09:58:38,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88064, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=2, TP: [cluster_name=ISPN] 09:58:38,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35755 09:58:38,997 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,001 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:39,001 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88064, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,001 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #49, conn_id=2) 09:58:39,001 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#49 09:58:39,001 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,001 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:39,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1c4e7b51){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:39,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:39,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:39,013 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,014 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35755 09:58:39,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35755. 09:58:39,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35755}. ACQUIRED => RELEASED 09:58:39,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35755}? true 09:58:39,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35755} 09:58:39,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35755}, null) => true 09:58:39,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:39,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88062 to Test-NodeA-7051 09:58:39,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #52, conn_id=0) 09:58:39,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88062, rsp_expected=true, UNICAST3: DATA, seqno=52, TP: [cluster_name=ISPN] 09:58:39,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35755 09:58:39,019 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,019 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,019 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88062, rsp_expected=true, UNICAST3: DATA, seqno=52, TP: [cluster_name=ISPN] 09:58:39,019 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #52, conn_id=0) 09:58:39,019 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#52 09:58:39,019 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,019 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,019 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,019 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@66d525bc] 09:58:39,019 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:39,019 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:39,019 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:39,019 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:39,019 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,019 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,019 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:39,019 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,019 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,019 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:39,019 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88072] on Test-NodeB-10318 09:58:39,020 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #32, conn_id=1) 09:58:39,020 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88072, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,020 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,021 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:39,021 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88072, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,021 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #32, conn_id=1) 09:58:39,021 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#32 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88072 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:39,022 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #33) 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35760. timeout=10000 (MILLISECONDS) 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35760. Timeout=10000 (MILLISECONDS) 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35760} 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35760}. Current=null 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35760}) => true 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35760}. WAITING => ACQUIRED 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35760} successfully acquired the lock. 09:58:39,022 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,022 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,023 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #13) 09:58:39,023 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=13, conn_id=1, ts=14, TP: [cluster_name=ISPN] 09:58:39,023 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #49) 09:58:39,023 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,025 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,027 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6b023e1d] 09:58:39,027 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,024 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:39,024 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=49, conn_id=2, ts=15, TP: [cluster_name=ISPN] 09:58:39,029 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=13, conn_id=1, ts=14, TP: [cluster_name=ISPN] 09:58:39,029 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #13, conn-id=1, ts=14) 09:58:39,027 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:39,031 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35760. timeout=10000 (MILLISECONDS) 09:58:39,027 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=33, ts=16, TP: [cluster_name=ISPN] 09:58:39,031 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35760. Timeout=10000 (MILLISECONDS) 09:58:39,032 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,032 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:39,031 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,031 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #52) 09:58:39,031 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35760} 09:58:39,033 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:39,033 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:39,033 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=52, ts=17, TP: [cluster_name=ISPN] 09:58:39,033 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:39,033 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=33, ts=16, TP: [cluster_name=ISPN] 09:58:39,033 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #33, conn-id=0, ts=16) 09:58:39,035 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=49, conn_id=2, ts=15, TP: [cluster_name=ISPN] 09:58:39,036 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #49, conn-id=2, ts=15) 09:58:39,033 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,037 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:39,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,037 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=52, ts=17, TP: [cluster_name=ISPN] 09:58:39,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,038 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #52, conn-id=0, ts=17) 09:58:39,038 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:39,046 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(121df497){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,047 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,047 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,047 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,047 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,047 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,047 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88076] on Test-NodeC-52778 09:58:39,047 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #14, conn_id=1) 09:58:39,047 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88076, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,047 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,048 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:39,054 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88076, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,054 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #14, conn_id=1) 09:58:39,054 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#14 09:58:39,054 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88076 09:58:39,055 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:39,056 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,058 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,058 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6a601ccf] 09:58:39,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,061 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(504bf248){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(504bf248){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88076 to Test-NodeB-10318 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #14, conn_id=1) 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88076, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35760 09:58:39,062 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,062 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:39,062 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88076, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,062 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #14, conn_id=1) 09:58:39,064 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#14 09:58:39,064 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,064 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,064 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(121df497){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,065 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:39,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:39,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:39,069 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,070 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35760 09:58:39,070 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35760. 09:58:39,070 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35760}. ACQUIRED => RELEASED 09:58:39,071 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35760}? true 09:58:39,071 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35760} 09:58:39,071 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35760}, null) => true 09:58:39,071 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:39,072 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,072 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88072 to Test-NodeA-7051 09:58:39,074 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #34, conn_id=0) 09:58:39,074 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88072, rsp_expected=true, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 09:58:39,074 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35760 09:58:39,074 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,075 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,076 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88072, rsp_expected=true, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 09:58:39,080 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #34, conn_id=0) 09:58:39,080 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#34 09:58:39,080 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,080 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:39,080 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,080 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@47cd6637] 09:58:39,080 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:39,080 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:39,088 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:39,097 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:39,097 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,098 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,098 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:39,098 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,098 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,098 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,098 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88086] on Test-NodeC-52778 09:58:39,098 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #50, conn_id=2) 09:58:39,098 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88086, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,098 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,098 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:39,100 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88086, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,100 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #50, conn_id=2) 09:58:39,100 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#50 09:58:39,100 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88086 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35766. timeout=10000 (MILLISECONDS) 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35766. Timeout=10000 (MILLISECONDS) 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35766} 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35766}. Current=null 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35766}) => true 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35766}. WAITING => ACQUIRED 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35766} successfully acquired the lock. 09:58:39,101 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,101 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,105 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,105 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5e8972f4] 09:58:39,105 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,106 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:39,107 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35766. timeout=10000 (MILLISECONDS) 09:58:39,109 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35766. Timeout=10000 (MILLISECONDS) 09:58:39,109 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35766} 09:58:39,109 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:39,109 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:39,109 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,111 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,111 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:39,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4dadde2){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,113 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:39,113 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88092] on Test-NodeA-7051 09:58:39,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #53, conn_id=0) 09:58:39,116 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88092, rsp_expected=true, UNICAST3: DATA, seqno=53, TP: [cluster_name=ISPN] 09:58:39,119 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,119 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:39,121 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88092, rsp_expected=true, UNICAST3: DATA, seqno=53, TP: [cluster_name=ISPN] 09:58:39,122 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #53, conn_id=0) 09:58:39,122 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#53 09:58:39,122 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88092 09:58:39,122 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:39,123 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2961c241] 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(629af7f0){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(629af7f0){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88092 to Test-NodeC-52778 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #51, conn_id=2) 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88092, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,125 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35766 09:58:39,125 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,124 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,126 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:39,126 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88092, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,127 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #51, conn_id=2) 09:58:39,129 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#51 09:58:39,129 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,129 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:39,129 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4dadde2){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,130 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:39,130 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:39,133 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:39,133 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,137 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35766 09:58:39,148 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35766. 09:58:39,148 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35766}. ACQUIRED => RELEASED 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35766}? true 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35766} 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35766}, null) => true 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88086 to Test-NodeA-7051 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #54, conn_id=0) 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88086, rsp_expected=true, UNICAST3: DATA, seqno=54, TP: [cluster_name=ISPN] 09:58:39,155 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35766 09:58:39,155 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,155 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,157 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88086, rsp_expected=true, UNICAST3: DATA, seqno=54, TP: [cluster_name=ISPN] 09:58:39,157 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #54, conn_id=0) 09:58:39,159 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#54 09:58:39,159 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,161 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,163 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,163 DEBUG (testng-Test:[]) [Test] Found key key-to-change-0 with primary owner != Test-NodeA-7051, segment 60 09:58:39,163 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4ab55c3] 09:58:39,163 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,163 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,163 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-0 for read. Entry=null 09:58:39,163 TRACE (testng-Test:[]) [NonTxDistributionInterceptor] Doing a remote get for key key-to-change-0 09:58:39,163 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Perform remote get for key key-to-change-0. topologyId=-1, currentTopologyId=5 09:58:39,163 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:39,164 TRACE (testng-Test:[]) [GetKeyValueCommand] Entry not found 09:58:39,164 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:39,174 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:58:39,175 TRACE (ForkThread-1,Test:[]) [Test] Started fork runnable.. 09:58:39,177 TRACE (ForkThread-1,Test:[]) [Test] Adding segment listener 2062a222-bf65-43d0-b5a6-05e652a8e7df : org.infinispan.notifications.cachelistener.DistributedQueueingSegmentListener@7887d30f 09:58:39,175 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_complete_segment_invoked * 1 09:58:39,193 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 2062a222-bf65-43d0-b5a6-05e652a8e7df 09:58:39,194 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@57733cdd[Not completed] to remote execution at node Test-NodeB-10318 09:58:39,194 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@55bcb8ab] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,194 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@55bcb8ab], mode=SYNCHRONOUS, timeout=15000 09:58:39,194 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@55bcb8ab] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:39,194 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88108] on Test-NodeB-10318 09:58:39,194 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #33, conn_id=1) 09:58:39,194 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88108, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,194 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,194 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:39,194 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@adf6c80[Not completed] to remote execution at node Test-NodeC-52778 09:58:39,194 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@55bcb8ab] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,194 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@55bcb8ab], mode=SYNCHRONOUS, timeout=15000 09:58:39,194 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@55bcb8ab] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,194 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88109] on Test-NodeC-52778 09:58:39,194 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #52, conn_id=2) 09:58:39,194 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88108, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,194 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #33, conn_id=1) 09:58:39,194 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#33 09:58:39,194 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88108 09:58:39,195 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4ff5905] [sender=Test-NodeA-7051] 09:58:39,195 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:39,195 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,195 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4ff5905] 09:58:39,195 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 2062a222-bf65-43d0-b5a6-05e652a8e7df 09:58:39,195 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4ff5905] 09:58:39,194 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88109, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,196 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88108 to Test-NodeA-7051 09:58:39,196 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #35, conn_id=0) 09:58:39,198 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88108, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 09:58:39,198 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,198 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,198 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:39,199 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88109, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,199 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #52, conn_id=2) 09:58:39,199 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#52 09:58:39,199 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88109 09:58:39,199 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2addd51d] [sender=Test-NodeA-7051] 09:58:39,198 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,200 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88108, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 09:58:39,199 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:39,200 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,200 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2addd51d] 09:58:39,200 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #35, conn_id=0) 09:58:39,204 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 2062a222-bf65-43d0-b5a6-05e652a8e7df 09:58:39,204 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2addd51d] 09:58:39,204 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#35 09:58:39,205 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88109 to Test-NodeA-7051 09:58:39,205 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,205 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@55bcb8ab] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:39,205 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #55, conn_id=0) 09:58:39,206 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88109, rsp_expected=true, UNICAST3: DATA, seqno=55, TP: [cluster_name=ISPN] 09:58:39,206 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,206 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,207 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88109, rsp_expected=true, UNICAST3: DATA, seqno=55, TP: [cluster_name=ISPN] 09:58:39,208 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #55, conn_id=0) 09:58:39,208 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#55 09:58:39,209 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,209 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@55bcb8ab] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,210 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 2062a222-bf65-43d0-b5a6-05e652a8e7df requests initial state for cache 09:58:39,211 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@48fd468a] 09:58:39,211 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:39,212 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:39,212 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70512 09:58:39,213 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70512 excluding keys [] 09:58:39,216 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,216 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:39,217 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:39,217 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:39,217 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88117] on Test-NodeB-10318 09:58:39,219 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #34, conn_id=1) 09:58:39,219 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88117, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,219 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,220 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:39,224 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88117, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,224 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #34, conn_id=1) 09:58:39,224 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#34 09:58:39,224 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88117 09:58:39,224 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:39,225 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,225 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,225 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:39,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70512 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@2a1a9ad] 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70512 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70512 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70512 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70512 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70512 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:39,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88122] on Test-NodeA-7051 09:58:39,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #36, conn_id=0) 09:58:39,239 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88122, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 09:58:39,240 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (224 bytes (1120.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,240 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (227 bytes) 09:58:39,242 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=150 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88122, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 09:58:39,242 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #36, conn_id=0) 09:58:39,242 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#36 09:58:39,242 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88122 09:58:39,242 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:39,242 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:39,242 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,242 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:39,243 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70512 with [] suspected segments. 09:58:39,243 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:39,243 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:39,243 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 117, 247, 248, 252, 254, 127] 09:58:39,257 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:39,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88122 to Test-NodeB-10318 09:58:39,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #35, conn_id=1) 09:58:39,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88122, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,259 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,260 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:39,263 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88122, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,264 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #35, conn_id=1) 09:58:39,264 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#35 09:58:39,264 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:39,264 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:39,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:39,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88117 to Test-NodeA-7051 09:58:39,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #37, conn_id=0) 09:58:39,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88117, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 09:58:39,264 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,264 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:39,264 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88117, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 09:58:39,264 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #37, conn_id=0) 09:58:39,264 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#37 09:58:39,264 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:39,264 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:39,264 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70512 excluding keys [] 09:58:39,265 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,265 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:39,265 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:39,265 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,265 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88128] on Test-NodeC-52778 09:58:39,265 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #53, conn_id=2) 09:58:39,265 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88128, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,269 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,269 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:39,270 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88128, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,273 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #53, conn_id=2) 09:58:39,273 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#53 09:58:39,273 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88128 09:58:39,273 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:39,273 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,273 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,273 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:39,273 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70512 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:39,273 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@1ad7958e] 09:58:39,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:39,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70512 09:58:39,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70512 09:58:39,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70512 09:58:39,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:39,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70512 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:39,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70512 09:58:39,277 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,277 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:39,277 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:39,277 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88129] on Test-NodeA-7051 09:58:39,277 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #56, conn_id=0) 09:58:39,277 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88129, rsp_expected=true, UNICAST3: DATA, seqno=56, TP: [cluster_name=ISPN] 09:58:39,277 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,277 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:39,277 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88129, rsp_expected=true, UNICAST3: DATA, seqno=56, TP: [cluster_name=ISPN] 09:58:39,277 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #56, conn_id=0) 09:58:39,278 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#56 09:58:39,279 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88129 09:58:39,285 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:39,286 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:39,287 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:39,287 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70512 with [] suspected segments. 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [129, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 180, 181, 60, 63, 67, 195, 69, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 103, 107, 108, 236, 239, 240, 113, 241, 245, 119, 120, 249, 122, 124, 253] 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70512 as completed! 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88129 to Test-NodeC-52778 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #54, conn_id=2) 09:58:39,288 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88129, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,288 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,288 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:39,288 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88129, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,289 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #54, conn_id=2) 09:58:39,312 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,312 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-0 09:58:39,312 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_complete_segment_invoked * 1 (available = 1, total = 1) 09:58:39,312 TRACE (testng-Test:[]) [CheckPoint] Received event pre_complete_segment_invoked * 1 (available = 0, total = 1) 09:58:39,312 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_complete_segment_released * 1 09:58:39,312 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@29ff047a] 09:58:39,314 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:39,314 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:39,308 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#54 09:58:39,314 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:39,314 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:39,314 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:39,314 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88128 to Test-NodeA-7051 09:58:39,315 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #57, conn_id=0) 09:58:39,314 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:39,316 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? false 09:58:39,316 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,316 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,316 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:39,316 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,316 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,316 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,315 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88128, rsp_expected=true, UNICAST3: DATA, seqno=57, TP: [cluster_name=ISPN] 09:58:39,317 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,317 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:39,317 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88128, rsp_expected=true, UNICAST3: DATA, seqno=57, TP: [cluster_name=ISPN] 09:58:39,317 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #57, conn_id=0) 09:58:39,316 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88136] on Test-NodeC-52778 09:58:39,318 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #55, conn_id=2) 09:58:39,318 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88136, rsp_expected=true, UNICAST3: DATA, seqno=55, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,318 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (204 bytes (1020.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,319 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#57 09:58:39,318 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (207 bytes) 09:58:39,331 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #35) 09:58:39,331 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=35, conn_id=1, ts=14, TP: [cluster_name=ISPN] 09:58:39,332 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=130 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88136, rsp_expected=true, UNICAST3: DATA, seqno=55, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #55, conn_id=2) 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#55 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88136 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:35781. timeout=10000 (MILLISECONDS) 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35781. Timeout=10000 (MILLISECONDS) 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35781} 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35781}. Current=null 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35781}) => true 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35781}. WAITING => ACQUIRED 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35781} successfully acquired the lock. 09:58:39,336 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5793c599] 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-to-change-0'? true 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:35781. timeout=10000 (MILLISECONDS) 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35781. Timeout=10000 (MILLISECONDS) 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35781} 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:39,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6a15e2e2){key=key-to-change-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,333 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:39,349 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,350 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:39,350 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-70512 09:58:39,350 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:39,350 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:39,351 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [Test] Completed segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:39,351 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70512 09:58:39,351 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70512 being completed: true 09:58:39,351 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70512 09:58:39,332 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:39,331 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #14) 09:58:39,353 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=35, conn_id=1, ts=14, TP: [cluster_name=ISPN] 09:58:39,354 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #35, conn-id=1, ts=14) 09:58:39,353 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=14, conn_id=1, ts=15, TP: [cluster_name=ISPN] 09:58:39,354 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:39,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88144] on Test-NodeA-7051 09:58:39,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #58, conn_id=0) 09:58:39,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88144, rsp_expected=true, UNICAST3: DATA, seqno=58, TP: [cluster_name=ISPN] 09:58:39,354 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:39,373 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (204 bytes (1020.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,373 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (207 bytes) 09:58:39,374 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=130 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88144, rsp_expected=true, UNICAST3: DATA, seqno=58, TP: [cluster_name=ISPN] 09:58:39,374 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #58, conn_id=0) 09:58:39,374 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#58 09:58:39,374 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88144 09:58:39,374 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:39,374 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,374 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@568dfe4] 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,378 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=14, conn_id=1, ts=15, TP: [cluster_name=ISPN] 09:58:39,377 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:39,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(30f88dce){key=key-to-change-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,378 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #14, conn-id=1, ts=15) 09:58:39,382 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,382 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(30f88dce){key=key-to-change-0, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,382 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:39,382 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,382 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,382 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:39,397 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-0, value=new-value} in container 09:58:39,397 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,397 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,399 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88144 to Test-NodeC-52778 09:58:39,399 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #56, conn_id=2) 09:58:39,399 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88144, rsp_expected=true, UNICAST3: DATA, seqno=56, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,399 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35781 09:58:39,399 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,399 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:39,399 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88144, rsp_expected=true, UNICAST3: DATA, seqno=56, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,413 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #56, conn_id=2) 09:58:39,413 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#56 09:58:39,413 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,413 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:39,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6a15e2e2){key=key-to-change-0, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:39,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,413 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:39,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-0, value=new-value} in container 09:58:39,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, key=key-to-change-0, value=new-value, oldValue=null, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:58:39,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@7d4fae15[Not completed] to remote execution at node Test-NodeA-7051 09:58:39,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3dce96bd] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3dce96bd], mode=SYNCHRONOUS, timeout=15000 09:58:39,439 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3dce96bd] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:39,440 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88154] on Test-NodeA-7051 09:58:39,440 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #59, conn_id=0) 09:58:39,440 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88154, rsp_expected=true, UNICAST3: DATA, seqno=59, TP: [cluster_name=ISPN] 09:58:39,440 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (374 bytes (1870.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,440 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (377 bytes) 09:58:39,450 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=300 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88154, rsp_expected=true, UNICAST3: DATA, seqno=59, TP: [cluster_name=ISPN] 09:58:39,450 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #59, conn_id=0) 09:58:39,450 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#59 09:58:39,451 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88154 09:58:39,452 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@551218ce] [sender=Test-NodeC-52778] 09:58:39,452 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:39,452 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,452 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@551218ce] 09:58:39,452 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_CREATED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=new-value, oldValue=null, transaction=null, retryCommand=false, origin=Test-NodeC-52778}], notifying cluster listener with id 2062a222-bf65-43d0-b5a6-05e652a8e7df 09:58:39,452 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@551218ce] 09:58:39,452 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88154 to Test-NodeC-52778 09:58:39,452 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #57, conn_id=2) 09:58:39,452 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88154, rsp_expected=true, UNICAST3: DATA, seqno=57, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,457 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,457 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:39,458 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88154, rsp_expected=true, UNICAST3: DATA, seqno=57, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,458 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #57, conn_id=2) 09:58:39,458 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#57 09:58:39,458 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,458 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3dce96bd] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:35781 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35781. 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35781}. ACQUIRED => RELEASED 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35781}? true 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35781} 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35781}, null) => true 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88136 to Test-NodeA-7051 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #60, conn_id=0) 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88136, rsp_expected=true, UNICAST3: DATA, seqno=60, TP: [cluster_name=ISPN] 09:58:39,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:35781 09:58:39,459 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,459 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,461 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88136, rsp_expected=true, UNICAST3: DATA, seqno=60, TP: [cluster_name=ISPN] 09:58:39,461 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #60, conn_id=0) 09:58:39,461 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#60 09:58:39,461 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,461 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,462 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,462 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_complete_segment_released * 999999999 (available = 999999999, total = 999999999) 09:58:39,462 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_complete_segment_released * 1 (available = 999999998, total = 999999999) 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:39,462 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:39,463 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [244, 251] 09:58:39,463 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,463 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-8 09:58:39,463 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:39,463 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:39,464 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,464 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-1 09:58:39,467 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,467 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-4 09:58:39,467 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,468 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-3 09:58:39,468 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,468 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-2 09:58:39,469 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,469 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-9 09:58:39,482 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,489 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-7 09:58:39,489 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [48, 2, 229, 118, 71, 72, 233] 09:58:39,489 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,489 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-6 09:58:39,489 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:39,490 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:39,490 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:39,490 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:39,490 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:39,490 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:39,490 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:39,490 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [24] 09:58:39,490 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,490 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-5 09:58:39,490 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:39,490 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=new-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:39,490 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 2062a222-bf65-43d0-b5a6-05e652a8e7df initial state for cache completed 09:58:39,490 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork runnable. 09:58:39,490 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@7678b7cc[Not completed] to self 09:58:39,491 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@11a622b5[Not completed] to remote execution at node Test-NodeB-10318 09:58:39,491 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3282cb3e] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,491 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3282cb3e], mode=SYNCHRONOUS, timeout=15000 09:58:39,494 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3282cb3e] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:39,515 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88162] on Test-NodeB-10318 09:58:39,515 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #36, conn_id=1) 09:58:39,515 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88162, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,516 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@47f83941[Not completed] to remote execution at node Test-NodeC-52778 09:58:39,516 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3282cb3e] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,516 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3282cb3e], mode=SYNCHRONOUS, timeout=15000 09:58:39,516 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3282cb3e] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,518 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,518 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:39,518 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88162, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,518 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #36, conn_id=1) 09:58:39,518 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#36 09:58:39,518 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88162 09:58:39,518 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3408bcfb] [sender=Test-NodeA-7051] 09:58:39,518 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:39,519 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3408bcfb] 09:58:39,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 2062a222-bf65-43d0-b5a6-05e652a8e7df 09:58:39,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3408bcfb] 09:58:39,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88162 to Test-NodeA-7051 09:58:39,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #38, conn_id=0) 09:58:39,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88162, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 09:58:39,519 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,519 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,526 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88162, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 09:58:39,526 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #38, conn_id=0) 09:58:39,526 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#38 09:58:39,526 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,526 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3282cb3e] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:39,516 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88164] on Test-NodeC-52778 09:58:39,527 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #58, conn_id=2) 09:58:39,527 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88164, rsp_expected=true, UNICAST3: DATA, seqno=58, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,527 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,527 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:39,527 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88164, rsp_expected=true, UNICAST3: DATA, seqno=58, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,527 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #58, conn_id=2) 09:58:39,527 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#58 09:58:39,527 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88164 09:58:39,527 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@297f832d] [sender=Test-NodeA-7051] 09:58:39,527 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:39,527 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,527 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@297f832d] 09:58:39,532 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #14) 09:58:39,532 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=14, conn_id=1, ts=16, TP: [cluster_name=ISPN] 09:58:39,532 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #58) 09:58:39,532 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=58, conn_id=2, ts=17, TP: [cluster_name=ISPN] 09:58:39,533 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:39,533 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:39,533 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:39,533 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=14, conn_id=1, ts=16, TP: [cluster_name=ISPN] 09:58:39,533 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #14, conn-id=1, ts=16) 09:58:39,533 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=58, conn_id=2, ts=17, TP: [cluster_name=ISPN] 09:58:39,533 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #58, conn-id=2, ts=17) 09:58:39,533 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #38) 09:58:39,533 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=38, ts=18, TP: [cluster_name=ISPN] 09:58:39,533 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #60) 09:58:39,533 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,533 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:39,533 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=38, ts=18, TP: [cluster_name=ISPN] 09:58:39,533 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #38, conn-id=0, ts=18) 09:58:39,533 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=60, ts=19, TP: [cluster_name=ISPN] 09:58:39,546 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,546 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:39,547 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=60, ts=19, TP: [cluster_name=ISPN] 09:58:39,547 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #60, conn-id=0, ts=19) 09:58:39,549 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 2062a222-bf65-43d0-b5a6-05e652a8e7df 09:58:39,549 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@297f832d] 09:58:39,549 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88164 to Test-NodeA-7051 09:58:39,549 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #61, conn_id=0) 09:58:39,549 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88164, rsp_expected=true, UNICAST3: DATA, seqno=61, TP: [cluster_name=ISPN] 09:58:39,549 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,554 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,554 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88164, rsp_expected=true, UNICAST3: DATA, seqno=61, TP: [cluster_name=ISPN] 09:58:39,559 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #61, conn_id=0) 09:58:39,559 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#61 09:58:39,559 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,559 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3282cb3e] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,560 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered 09:58:39,560 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:39,568 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:39,579 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:39,579 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:39,579 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:39,579 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:39,579 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:58:39,579 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:39,580 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:39,580 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 10 09:58:39,580 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:39,580 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:39,595 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:39,595 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:39,596 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganAndSegmentNotCompleteValueOwnerClustered 09:58:39,596 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@124c45c2] 09:58:39,596 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:39,596 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:39,596 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:39,596 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:39,603 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,603 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,625 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:39,625 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,626 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,626 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:39,626 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88176] on Test-NodeB-10318 09:58:39,626 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #37, conn_id=1) 09:58:39,626 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88176, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,626 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,626 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:39,626 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88176, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,638 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #37, conn_id=1) 09:58:39,638 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#37 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88176 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35788. timeout=10000 (MILLISECONDS) 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35788. Timeout=10000 (MILLISECONDS) 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35788} 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35788}. Current=null 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35788}) => true 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35788}. WAITING => ACQUIRED 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35788} successfully acquired the lock. 09:58:39,656 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5193bce9] 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35788. timeout=10000 (MILLISECONDS) 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35788. Timeout=10000 (MILLISECONDS) 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35788} 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(dbb056f){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88181] on Test-NodeC-52778 09:58:39,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #15, conn_id=1) 09:58:39,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88181, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,657 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,657 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:39,657 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88181, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,657 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #15, conn_id=1) 09:58:39,657 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#15 09:58:39,657 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88181 09:58:39,657 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:39,657 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,657 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,657 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,657 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@19dee1dd] 09:58:39,657 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,657 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(640a5836){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(640a5836){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88181 to Test-NodeB-10318 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #15, conn_id=1) 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88181, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,658 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35788 09:58:39,658 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,658 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:39,657 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,658 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88181, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,658 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #15, conn_id=1) 09:58:39,658 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#15 09:58:39,658 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,659 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(dbb056f){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35788 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35788. 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35788}. ACQUIRED => RELEASED 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35788}? true 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35788} 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35788}, null) => true 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88176 to Test-NodeA-7051 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #39, conn_id=0) 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88176, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 09:58:39,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35788 09:58:39,659 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,659 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,659 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88176, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 09:58:39,659 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #39, conn_id=0) 09:58:39,659 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#39 09:58:39,659 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,660 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:39,660 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,660 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@45d950d3] 09:58:39,660 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:39,660 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:39,660 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:39,660 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:39,660 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,660 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,660 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:39,660 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,660 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,660 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,660 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88182] on Test-NodeC-52778 09:58:39,660 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #59, conn_id=2) 09:58:39,660 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88182, rsp_expected=true, UNICAST3: DATA, seqno=59, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,660 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,660 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88182, rsp_expected=true, UNICAST3: DATA, seqno=59, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #59, conn_id=2) 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#59 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88182 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35790. timeout=10000 (MILLISECONDS) 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35790. Timeout=10000 (MILLISECONDS) 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35790} 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35790}. Current=null 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35790}) => true 09:58:39,660 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35790}. WAITING => ACQUIRED 09:58:39,661 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35790} successfully acquired the lock. 09:58:39,661 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@678d8d5a] 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35790. timeout=10000 (MILLISECONDS) 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35790. Timeout=10000 (MILLISECONDS) 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35790} 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2b62031f){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,661 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,662 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,662 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:39,662 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88183] on Test-NodeA-7051 09:58:39,662 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #62, conn_id=0) 09:58:39,662 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88183, rsp_expected=true, UNICAST3: DATA, seqno=62, TP: [cluster_name=ISPN] 09:58:39,662 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,662 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:39,662 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88183, rsp_expected=true, UNICAST3: DATA, seqno=62, TP: [cluster_name=ISPN] 09:58:39,662 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #62, conn_id=0) 09:58:39,662 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#62 09:58:39,662 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88183 09:58:39,662 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:39,662 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,662 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@18bc509f] 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(59505c82){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(59505c82){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:39,663 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88183 to Test-NodeC-52778 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #60, conn_id=2) 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88183, rsp_expected=true, UNICAST3: DATA, seqno=60, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,690 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,690 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:39,690 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88183, rsp_expected=true, UNICAST3: DATA, seqno=60, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,690 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #60, conn_id=2) 09:58:39,690 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35790 09:58:39,707 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#60 09:58:39,714 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,714 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:39,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2b62031f){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35790 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35790. 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35790}. ACQUIRED => RELEASED 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35790}? true 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35790} 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35790}, null) => true 09:58:39,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:39,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88182 to Test-NodeA-7051 09:58:39,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #63, conn_id=0) 09:58:39,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88182, rsp_expected=true, UNICAST3: DATA, seqno=63, TP: [cluster_name=ISPN] 09:58:39,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35790 09:58:39,725 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,725 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:39,725 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88182, rsp_expected=true, UNICAST3: DATA, seqno=63, TP: [cluster_name=ISPN] 09:58:39,725 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #63, conn_id=0) 09:58:39,725 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#63 09:58:39,725 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,749 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:39,854 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #37) 09:58:39,750 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,858 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@258984e1] 09:58:39,858 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:39,858 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:39,858 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:39,858 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:39,854 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=37, conn_id=1, ts=16, TP: [cluster_name=ISPN] 09:58:39,878 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:39,879 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,885 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,885 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:39,885 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,885 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,878 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:39,885 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:39,886 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88192] on Test-NodeC-52778 09:58:39,886 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=37, conn_id=1, ts=16, TP: [cluster_name=ISPN] 09:58:39,886 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #37, conn-id=1, ts=16) 09:58:39,878 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #15) 09:58:39,888 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=17, TP: [cluster_name=ISPN] 09:58:39,886 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #61, conn_id=2) 09:58:39,888 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,888 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:39,888 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88192, rsp_expected=true, UNICAST3: DATA, seqno=61, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,900 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=17, TP: [cluster_name=ISPN] 09:58:39,900 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #15, conn-id=1, ts=17) 09:58:39,905 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,913 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:39,932 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88192, rsp_expected=true, UNICAST3: DATA, seqno=61, conn_id=2, TP: [cluster_name=ISPN] 09:58:39,932 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #61, conn_id=2) 09:58:39,932 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#61 09:58:39,932 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88192 09:58:39,932 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:39,933 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,933 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35795. timeout=10000 (MILLISECONDS) 09:58:39,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35795. Timeout=10000 (MILLISECONDS) 09:58:39,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35795} 09:58:39,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35795}. Current=null 09:58:39,943 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35795}) => true 09:58:39,943 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35795}. WAITING => ACQUIRED 09:58:39,943 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35795} successfully acquired the lock. 09:58:39,944 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,946 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,946 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1cf56fda] 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35795. timeout=10000 (MILLISECONDS) 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35795. Timeout=10000 (MILLISECONDS) 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35795} 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(e2f6cad){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:39,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:39,948 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88197] on Test-NodeB-10318 09:58:39,948 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #16, conn_id=1) 09:58:39,948 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88197, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,948 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:39,948 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:39,948 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88197, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,950 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #16, conn_id=1) 09:58:39,950 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#16 09:58:39,950 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88197 09:58:39,950 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:39,951 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:39,951 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:39,951 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,951 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:39,951 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@fbaa348] 09:58:39,951 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:39,951 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:39,951 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:39,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:39,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:39,966 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:39,966 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:39,966 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5f1ab836){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:39,968 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:39,973 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:39,973 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5f1ab836){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,973 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:39,974 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,974 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,976 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:39,976 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:39,976 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:39,976 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:39,977 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88197 to Test-NodeC-52778 09:58:39,977 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #16, conn_id=1) 09:58:39,977 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88197, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,977 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35795 09:58:39,977 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:39,977 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:39,989 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88197, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 09:58:39,989 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #16, conn_id=1) 09:58:39,989 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#16 09:58:39,989 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:39,989 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:39,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(e2f6cad){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:39,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:39,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:39,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:39,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:39,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:39,997 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,000 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35795 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35795. 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35795}. ACQUIRED => RELEASED 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35795}? true 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35795} 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35795}, null) => true 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88192 to Test-NodeA-7051 09:58:40,003 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #64, conn_id=0) 09:58:40,004 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88192, rsp_expected=true, UNICAST3: DATA, seqno=64, TP: [cluster_name=ISPN] 09:58:40,004 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35795 09:58:40,004 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,004 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,028 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88192, rsp_expected=true, UNICAST3: DATA, seqno=64, TP: [cluster_name=ISPN] 09:58:40,028 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #64, conn_id=0) 09:58:40,028 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#64 09:58:40,028 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,029 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:40,029 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,029 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7cde2eca] 09:58:40,029 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:40,029 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:40,029 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:40,029 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:40,029 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,029 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,029 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:40,029 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,029 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,029 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:40,029 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88206] on Test-NodeC-52778 09:58:40,029 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #62, conn_id=2) 09:58:40,029 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88206, rsp_expected=true, UNICAST3: DATA, seqno=62, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,029 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,029 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:40,033 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #16) 09:58:40,033 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=16, conn_id=1, ts=18, TP: [cluster_name=ISPN] 09:58:40,033 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #61) 09:58:40,033 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=61, conn_id=2, ts=19, TP: [cluster_name=ISPN] 09:58:40,033 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:40,031 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88206, rsp_expected=true, UNICAST3: DATA, seqno=62, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,035 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #62, conn_id=2) 09:58:40,035 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#62 09:58:40,035 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88206 09:58:40,035 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:40,034 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:40,037 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,037 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:40,037 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=16, conn_id=1, ts=18, TP: [cluster_name=ISPN] 09:58:40,037 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #16, conn-id=1, ts=18) 09:58:40,037 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=61, conn_id=2, ts=19, TP: [cluster_name=ISPN] 09:58:40,037 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #61, conn-id=2, ts=19) 09:58:40,035 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,040 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35802. timeout=10000 (MILLISECONDS) 09:58:40,052 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #39) 09:58:40,052 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=39, ts=20, TP: [cluster_name=ISPN] 09:58:40,052 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #64) 09:58:40,052 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=64, ts=21, TP: [cluster_name=ISPN] 09:58:40,052 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:40,052 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:40,052 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=39, ts=20, TP: [cluster_name=ISPN] 09:58:40,052 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #39, conn-id=0, ts=20) 09:58:40,052 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,052 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:40,053 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=64, ts=21, TP: [cluster_name=ISPN] 09:58:40,053 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #64, conn-id=0, ts=21) 09:58:40,066 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35802. Timeout=10000 (MILLISECONDS) 09:58:40,066 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35802} 09:58:40,066 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35802}. Current=null 09:58:40,066 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35802}) => true 09:58:40,066 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35802}. WAITING => ACQUIRED 09:58:40,066 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35802} successfully acquired the lock. 09:58:40,066 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,066 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@22af06cb] 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35802. timeout=10000 (MILLISECONDS) 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35802. Timeout=10000 (MILLISECONDS) 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35802} 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(218a02d1){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88211] on Test-NodeB-10318 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #17, conn_id=1) 09:58:40,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88211, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,072 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:40,072 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:40,072 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88211, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,073 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #17, conn_id=1) 09:58:40,074 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#17 09:58:40,074 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88211 09:58:40,074 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:40,074 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7586ffb2] 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4ef337f8){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4ef337f8){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88211 to Test-NodeC-52778 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #17, conn_id=1) 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88211, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35802 09:58:40,078 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,078 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:40,079 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88211, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,079 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #17, conn_id=1) 09:58:40,079 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#17 09:58:40,079 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,079 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(218a02d1){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35802 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35802. 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35802}. ACQUIRED => RELEASED 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35802}? true 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35802} 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35802}, null) => true 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88206 to Test-NodeA-7051 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #65, conn_id=0) 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88206, rsp_expected=true, UNICAST3: DATA, seqno=65, TP: [cluster_name=ISPN] 09:58:40,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35802 09:58:40,079 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,080 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,080 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88206, rsp_expected=true, UNICAST3: DATA, seqno=65, TP: [cluster_name=ISPN] 09:58:40,080 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #65, conn_id=0) 09:58:40,080 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#65 09:58:40,078 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,080 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,083 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:40,084 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,084 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@675560b5] 09:58:40,084 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:40,084 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:40,084 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:40,084 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:40,084 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,084 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,084 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:40,084 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,084 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,084 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:40,084 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88214] on Test-NodeC-52778 09:58:40,084 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #63, conn_id=2) 09:58:40,084 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88214, rsp_expected=true, UNICAST3: DATA, seqno=63, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,084 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,085 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:40,085 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88214, rsp_expected=true, UNICAST3: DATA, seqno=63, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #63, conn_id=2) 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#63 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88214 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35805. timeout=10000 (MILLISECONDS) 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35805. Timeout=10000 (MILLISECONDS) 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35805} 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35805}. Current=null 09:58:40,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35805}) => true 09:58:40,087 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35805}. WAITING => ACQUIRED 09:58:40,087 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35805} successfully acquired the lock. 09:58:40,087 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2981a433] 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35805. timeout=10000 (MILLISECONDS) 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35805. Timeout=10000 (MILLISECONDS) 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35805} 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6e3b7905){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,087 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,088 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:40,088 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88215] on Test-NodeA-7051 09:58:40,088 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #66, conn_id=0) 09:58:40,088 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88215, rsp_expected=true, UNICAST3: DATA, seqno=66, TP: [cluster_name=ISPN] 09:58:40,088 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,090 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:40,090 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88215, rsp_expected=true, UNICAST3: DATA, seqno=66, TP: [cluster_name=ISPN] 09:58:40,091 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #66, conn_id=0) 09:58:40,091 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#66 09:58:40,092 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88215 09:58:40,092 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:40,092 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,092 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1a842fb3] 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6e6657d0){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6e6657d0){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:40,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88215 to Test-NodeC-52778 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #64, conn_id=2) 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88215, rsp_expected=true, UNICAST3: DATA, seqno=64, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35805 09:58:40,093 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,093 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:40,093 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88215, rsp_expected=true, UNICAST3: DATA, seqno=64, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,094 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #64, conn_id=2) 09:58:40,094 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#64 09:58:40,094 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,094 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:40,094 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6e3b7905){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,094 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:40,094 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,095 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,097 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:40,097 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:40,099 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35805 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35805. 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35805}. ACQUIRED => RELEASED 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35805}? true 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35805} 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35805}, null) => true 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88214 to Test-NodeA-7051 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #67, conn_id=0) 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88214, rsp_expected=true, UNICAST3: DATA, seqno=67, TP: [cluster_name=ISPN] 09:58:40,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35805 09:58:40,120 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,120 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,121 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88214, rsp_expected=true, UNICAST3: DATA, seqno=67, TP: [cluster_name=ISPN] 09:58:40,121 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #67, conn_id=0) 09:58:40,121 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#67 09:58:40,121 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,121 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:40,121 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,121 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@11562fb6] 09:58:40,129 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:40,129 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:40,129 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:35810. timeout=10000 (MILLISECONDS) 09:58:40,129 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35810. Timeout=10000 (MILLISECONDS) 09:58:40,129 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35810} 09:58:40,130 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35810}. Current=null 09:58:40,130 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35810}) => true 09:58:40,130 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35810}. WAITING => ACQUIRED 09:58:40,130 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35810} successfully acquired the lock. 09:58:40,130 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:40,130 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:40,130 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,130 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,130 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:40,130 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(24fd6106){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,130 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,130 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,130 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:40,130 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,130 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,130 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:40,131 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88225] on Test-NodeB-10318 09:58:40,131 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #38, conn_id=1) 09:58:40,131 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88225, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,131 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:40,131 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:40,131 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88225, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,131 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #38, conn_id=1) 09:58:40,132 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#38 09:58:40,132 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88225 09:58:40,134 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:40,134 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,134 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,134 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,134 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@14896d8d] 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1e58bc22){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,156 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,156 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1e58bc22){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88225 to Test-NodeA-7051 09:58:40,169 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #40, conn_id=0) 09:58:40,170 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88225, rsp_expected=true, UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 09:58:40,170 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35810 09:58:40,170 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,170 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,170 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88225, rsp_expected=true, UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 09:58:40,170 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #40, conn_id=0) 09:58:40,171 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#40 09:58:40,171 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,171 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:40,171 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(24fd6106){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,171 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:40,171 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,171 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,171 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:40,171 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:40,171 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,171 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:35810 09:58:40,171 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35810. 09:58:40,171 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35810}. ACQUIRED => RELEASED 09:58:40,171 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35810}? true 09:58:40,171 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35810} 09:58:40,171 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35810}, null) => true 09:58:40,171 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:40,171 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@133a5b1b] 09:58:40,171 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:40,171 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:40,171 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:40,171 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:40,171 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,171 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,171 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:40,171 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,171 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,171 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:40,171 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88229] on Test-NodeC-52778 09:58:40,201 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #65, conn_id=2) 09:58:40,201 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88229, rsp_expected=true, UNICAST3: DATA, seqno=65, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,201 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,217 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:40,221 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88229, rsp_expected=true, UNICAST3: DATA, seqno=65, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,221 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #65, conn_id=2) 09:58:40,221 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#65 09:58:40,221 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88229 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35814. timeout=10000 (MILLISECONDS) 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35814. Timeout=10000 (MILLISECONDS) 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35814} 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35814}. Current=null 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35814}) => true 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35814}. WAITING => ACQUIRED 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35814} successfully acquired the lock. 09:58:40,229 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3be54a] 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35814. timeout=10000 (MILLISECONDS) 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35814. Timeout=10000 (MILLISECONDS) 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35814} 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(551a4f24){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88238] on Test-NodeA-7051 09:58:40,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #68, conn_id=0) 09:58:40,230 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88238, rsp_expected=true, UNICAST3: DATA, seqno=68, TP: [cluster_name=ISPN] 09:58:40,230 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,230 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:40,230 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88238, rsp_expected=true, UNICAST3: DATA, seqno=68, TP: [cluster_name=ISPN] 09:58:40,230 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #68, conn_id=0) 09:58:40,230 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#68 09:58:40,230 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88238 09:58:40,230 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:40,230 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,230 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@14a4da2b] 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,230 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,238 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:40,238 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4f4b2071){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,238 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,238 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,238 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4f4b2071){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,238 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:40,252 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,285 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:40,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:40,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88238 to Test-NodeC-52778 09:58:40,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #66, conn_id=2) 09:58:40,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88238, rsp_expected=true, UNICAST3: DATA, seqno=66, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,309 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,311 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:40,309 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35814 09:58:40,311 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88238, rsp_expected=true, UNICAST3: DATA, seqno=66, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,311 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #66, conn_id=2) 09:58:40,311 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#66 09:58:40,311 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,311 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:40,311 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(551a4f24){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,311 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35814 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35814. 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35814}. ACQUIRED => RELEASED 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35814}? true 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35814} 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35814}, null) => true 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88229 to Test-NodeA-7051 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #69, conn_id=0) 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88229, rsp_expected=true, UNICAST3: DATA, seqno=69, TP: [cluster_name=ISPN] 09:58:40,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35814 09:58:40,321 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,321 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,325 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88229, rsp_expected=true, UNICAST3: DATA, seqno=69, TP: [cluster_name=ISPN] 09:58:40,325 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #69, conn_id=0) 09:58:40,325 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#69 09:58:40,325 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,325 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:40,325 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,325 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@45c6295e] 09:58:40,326 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:40,326 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:40,326 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:40,326 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:40,326 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,326 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,326 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:40,326 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,326 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,326 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:40,326 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88252] on Test-NodeC-52778 09:58:40,326 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #67, conn_id=2) 09:58:40,326 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88252, rsp_expected=true, UNICAST3: DATA, seqno=67, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,326 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,326 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88252, rsp_expected=true, UNICAST3: DATA, seqno=67, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #67, conn_id=2) 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#67 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88252 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35821. timeout=10000 (MILLISECONDS) 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35821. Timeout=10000 (MILLISECONDS) 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35821} 09:58:40,326 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35821}. Current=null 09:58:40,327 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35821}) => true 09:58:40,327 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35821}. WAITING => ACQUIRED 09:58:40,327 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35821} successfully acquired the lock. 09:58:40,327 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5c32a84a] 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35821. timeout=10000 (MILLISECONDS) 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35821. Timeout=10000 (MILLISECONDS) 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35821} 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(983a644){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88253] on Test-NodeA-7051 09:58:40,327 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #70, conn_id=0) 09:58:40,330 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88253, rsp_expected=true, UNICAST3: DATA, seqno=70, TP: [cluster_name=ISPN] 09:58:40,331 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,331 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:40,331 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88253, rsp_expected=true, UNICAST3: DATA, seqno=70, TP: [cluster_name=ISPN] 09:58:40,331 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #70, conn_id=0) 09:58:40,331 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#70 09:58:40,331 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88253 09:58:40,331 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:40,331 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7409679c] 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(280d761a){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(280d761a){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,338 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:40,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:40,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88253 to Test-NodeC-52778 09:58:40,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #68, conn_id=2) 09:58:40,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88253, rsp_expected=true, UNICAST3: DATA, seqno=68, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,339 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35821 09:58:40,339 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,339 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:40,339 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88253, rsp_expected=true, UNICAST3: DATA, seqno=68, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,340 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #68, conn_id=2) 09:58:40,340 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#68 09:58:40,340 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,340 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:40,340 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(983a644){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,340 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:40,340 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,340 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,338 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,353 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:40,353 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35821 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35821. 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35821}. ACQUIRED => RELEASED 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35821}? true 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35821} 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35821}, null) => true 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88252 to Test-NodeA-7051 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #71, conn_id=0) 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88252, rsp_expected=true, UNICAST3: DATA, seqno=71, TP: [cluster_name=ISPN] 09:58:40,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35821 09:58:40,354 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,354 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,356 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88252, rsp_expected=true, UNICAST3: DATA, seqno=71, TP: [cluster_name=ISPN] 09:58:40,356 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #71, conn_id=0) 09:58:40,356 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#71 09:58:40,365 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,382 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:40,391 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #38) 09:58:40,391 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=38, conn_id=1, ts=18, TP: [cluster_name=ISPN] 09:58:40,391 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #17) 09:58:40,391 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=17, conn_id=1, ts=19, TP: [cluster_name=ISPN] 09:58:40,391 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:40,391 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:40,391 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:40,391 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=17, conn_id=1, ts=19, TP: [cluster_name=ISPN] 09:58:40,391 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #17, conn-id=1, ts=19) 09:58:40,391 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=38, conn_id=1, ts=18, TP: [cluster_name=ISPN] 09:58:40,391 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #38, conn-id=1, ts=18) 09:58:40,388 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,396 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1b665930] 09:58:40,396 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:40,396 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:40,413 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:40,413 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:40,414 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,414 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,420 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:40,420 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,424 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,425 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:40,425 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88273] on Test-NodeB-10318 09:58:40,425 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #39, conn_id=1) 09:58:40,425 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88273, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,425 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:40,431 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:40,440 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88273, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,440 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #39, conn_id=1) 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#39 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88273 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35823. timeout=10000 (MILLISECONDS) 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35823. Timeout=10000 (MILLISECONDS) 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35823} 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35823}. Current=null 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35823}) => true 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35823}. WAITING => ACQUIRED 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35823} successfully acquired the lock. 09:58:40,441 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5ce1ab34] 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35823. timeout=10000 (MILLISECONDS) 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35823. Timeout=10000 (MILLISECONDS) 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35823} 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:40,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,444 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,445 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(bfa0ba7){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88278] on Test-NodeC-52778 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #18, conn_id=1) 09:58:40,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88278, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,479 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,479 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:40,479 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88278, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,479 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #18, conn_id=1) 09:58:40,479 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#18 09:58:40,479 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88278 09:58:40,479 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:40,479 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,508 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,509 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,519 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2f5fd1cb] 09:58:40,519 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1c8ae2d5){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1c8ae2d5){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88278 to Test-NodeB-10318 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #18, conn_id=1) 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88278, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,520 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35823 09:58:40,520 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:40,520 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:40,521 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88278, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,521 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #18, conn_id=1) 09:58:40,521 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#18 09:58:40,521 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,535 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:40,535 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(bfa0ba7){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,535 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:40,535 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,535 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35823 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35823. 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35823}. ACQUIRED => RELEASED 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35823}? true 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35823} 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35823}, null) => true 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88273 to Test-NodeA-7051 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #41, conn_id=0) 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88273, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 09:58:40,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35823 09:58:40,536 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,536 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,536 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88273, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 09:58:40,536 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #41, conn_id=0) 09:58:40,536 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#41 09:58:40,536 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,536 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:40,536 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,536 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@43b65429] 09:58:40,536 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:40,536 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:40,536 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:40,537 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:40,537 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,537 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,537 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:40,537 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,537 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,537 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:40,537 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88286] on Test-NodeC-52778 09:58:40,537 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #69, conn_id=2) 09:58:40,533 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #18) 09:58:40,601 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=18, conn_id=1, ts=20, TP: [cluster_name=ISPN] 09:58:40,601 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #68) 09:58:40,601 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=68, conn_id=2, ts=21, TP: [cluster_name=ISPN] 09:58:40,601 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:40,601 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:40,602 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:40,602 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=18, conn_id=1, ts=20, TP: [cluster_name=ISPN] 09:58:40,602 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=68, conn_id=2, ts=21, TP: [cluster_name=ISPN] 09:58:40,602 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #18, conn-id=1, ts=20) 09:58:40,602 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #68, conn-id=2, ts=21) 09:58:40,595 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #41) 09:58:40,630 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=41, ts=22, TP: [cluster_name=ISPN] 09:58:40,537 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88286, rsp_expected=true, UNICAST3: DATA, seqno=69, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,630 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:40,630 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:40,630 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #71) 09:58:40,631 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=41, ts=22, TP: [cluster_name=ISPN] 09:58:40,631 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #41, conn-id=0, ts=22) 09:58:40,631 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=71, ts=23, TP: [cluster_name=ISPN] 09:58:40,630 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,635 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:40,636 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88286, rsp_expected=true, UNICAST3: DATA, seqno=69, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,636 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #69, conn_id=2) 09:58:40,639 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#69 09:58:40,635 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,639 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88286 09:58:40,639 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:40,639 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35828. timeout=10000 (MILLISECONDS) 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35828. Timeout=10000 (MILLISECONDS) 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35828} 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35828}. Current=null 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35828}) => true 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35828}. WAITING => ACQUIRED 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35828} successfully acquired the lock. 09:58:40,655 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@127546f1] 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35828. timeout=10000 (MILLISECONDS) 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35828. Timeout=10000 (MILLISECONDS) 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35828} 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(394403e3){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,655 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=71, ts=23, TP: [cluster_name=ISPN] 09:58:40,655 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #71, conn-id=0, ts=23) 09:58:40,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:40,674 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:40,674 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88298] on Test-NodeA-7051 09:58:40,674 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #72, conn_id=0) 09:58:40,674 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88298, rsp_expected=true, UNICAST3: DATA, seqno=72, TP: [cluster_name=ISPN] 09:58:40,674 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,675 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:40,688 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88298, rsp_expected=true, UNICAST3: DATA, seqno=72, TP: [cluster_name=ISPN] 09:58:40,688 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #72, conn_id=0) 09:58:40,688 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#72 09:58:40,688 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88298 09:58:40,688 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:40,688 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,688 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1a4a84b2] 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:40,688 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(c146722){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:40,710 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:40,710 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:40,710 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(c146722){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,716 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:40,721 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,721 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,721 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:40,724 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:40,724 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,724 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,725 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88298 to Test-NodeC-52778 09:58:40,725 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #70, conn_id=2) 09:58:40,725 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88298, rsp_expected=true, UNICAST3: DATA, seqno=70, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,725 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35828 09:58:40,725 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,725 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:40,729 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88298, rsp_expected=true, UNICAST3: DATA, seqno=70, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,737 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #70, conn_id=2) 09:58:40,737 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#70 09:58:40,738 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,738 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:40,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(394403e3){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:40,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:40,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:40,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:40,739 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:40,739 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:40,761 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,761 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35828 09:58:40,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35828. 09:58:40,780 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35828}. ACQUIRED => RELEASED 09:58:40,782 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35828}? true 09:58:40,782 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35828} 09:58:40,809 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35828}, null) => true 09:58:40,809 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:40,809 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:40,809 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88286 to Test-NodeA-7051 09:58:40,809 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #73, conn_id=0) 09:58:40,809 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88286, rsp_expected=true, UNICAST3: DATA, seqno=73, TP: [cluster_name=ISPN] 09:58:40,809 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35828 09:58:40,809 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,809 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,809 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88286, rsp_expected=true, UNICAST3: DATA, seqno=73, TP: [cluster_name=ISPN] 09:58:40,810 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #73, conn_id=0) 09:58:40,810 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#73 09:58:40,810 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,810 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:40,812 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:40,812 DEBUG (testng-Test:[]) [Test] Found key key-to-change-1 with primary owner Test-NodeA-7051, segment 175 09:58:40,812 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@15ee3846] 09:58:40,812 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:40,812 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:40,812 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-1 for read. Entry=null 09:58:40,812 TRACE (testng-Test:[]) [NonTxDistributionInterceptor] Doing a remote get for key key-to-change-1 09:58:40,812 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Perform remote get for key key-to-change-1. topologyId=-1, currentTopologyId=5 09:58:40,812 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:40,812 TRACE (testng-Test:[]) [GetKeyValueCommand] Entry not found 09:58:40,812 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:40,812 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:58:40,819 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_complete_segment_invoked * 1 09:58:40,820 TRACE (ForkThread-1,Test:[]) [Test] Started fork runnable.. 09:58:40,823 TRACE (ForkThread-1,Test:[]) [Test] Adding segment listener ac5c67fc-dbc2-474f-8928-90453dfabef4 : org.infinispan.notifications.cachelistener.DistributedQueueingSegmentListener@56aea6b6 09:58:40,824 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id ac5c67fc-dbc2-474f-8928-90453dfabef4 09:58:40,824 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@3d51b57f[Not completed] to remote execution at node Test-NodeB-10318 09:58:40,824 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@68d465b4] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,856 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@68d465b4], mode=SYNCHRONOUS, timeout=15000 09:58:40,856 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@68d465b4] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:40,856 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88313] on Test-NodeB-10318 09:58:40,856 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #40, conn_id=1) 09:58:40,856 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88313, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,856 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@2c1c0fb0[Not completed] to remote execution at node Test-NodeC-52778 09:58:40,856 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@68d465b4] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,856 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@68d465b4], mode=SYNCHRONOUS, timeout=15000 09:58:40,856 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@68d465b4] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:40,856 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88314] on Test-NodeC-52778 09:58:40,857 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #71, conn_id=2) 09:58:40,857 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88314, rsp_expected=true, UNICAST3: DATA, seqno=71, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,857 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (472 bytes (2360.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:40,857 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:40,857 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:40,858 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88313, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,858 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88314, rsp_expected=true, UNICAST3: DATA, seqno=71, conn_id=2, TP: [cluster_name=ISPN] 09:58:40,869 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #71, conn_id=2) 09:58:40,891 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #39) 09:58:40,891 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=39, conn_id=1, ts=20, TP: [cluster_name=ISPN] 09:58:40,869 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#71 09:58:40,895 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88314 09:58:40,869 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #40, conn_id=1) 09:58:40,896 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@52c00379] [sender=Test-NodeA-7051] 09:58:40,905 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#40 09:58:40,905 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88313 09:58:40,905 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4472e448] [sender=Test-NodeA-7051] 09:58:40,905 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:40,891 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,891 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #18) 09:58:40,906 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=18, conn_id=1, ts=21, TP: [cluster_name=ISPN] 09:58:40,906 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:40,917 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=39, conn_id=1, ts=20, TP: [cluster_name=ISPN] 09:58:40,917 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #39, conn-id=1, ts=20) 09:58:40,916 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:40,917 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:40,917 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=18, conn_id=1, ts=21, TP: [cluster_name=ISPN] 09:58:40,917 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #18, conn-id=1, ts=21) 09:58:40,905 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4472e448] 09:58:40,918 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id ac5c67fc-dbc2-474f-8928-90453dfabef4 09:58:40,918 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4472e448] 09:58:40,918 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88313 to Test-NodeA-7051 09:58:40,918 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #42, conn_id=0) 09:58:40,918 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88313, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 09:58:40,905 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,905 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:40,922 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,922 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@52c00379] 09:58:40,936 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id ac5c67fc-dbc2-474f-8928-90453dfabef4 09:58:40,937 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@52c00379] 09:58:40,937 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88314 to Test-NodeA-7051 09:58:40,937 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #74, conn_id=0) 09:58:40,937 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88314, rsp_expected=true, UNICAST3: DATA, seqno=74, TP: [cluster_name=ISPN] 09:58:40,937 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,937 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,937 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88314, rsp_expected=true, UNICAST3: DATA, seqno=74, TP: [cluster_name=ISPN] 09:58:40,937 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #74, conn_id=0) 09:58:40,937 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#74 09:58:40,937 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,937 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@68d465b4] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:40,918 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,940 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:40,940 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88313, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 09:58:40,941 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #42, conn_id=0) 09:58:40,941 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#42 09:58:40,941 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:40,941 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@68d465b4] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:40,941 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener ac5c67fc-dbc2-474f-8928-90453dfabef4 requests initial state for cache 09:58:40,941 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@4bc67b3c] 09:58:40,941 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:40,952 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:40,953 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70513 09:58:40,954 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70513 excluding keys [] 09:58:40,954 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,954 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:40,972 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:40,972 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:40,973 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88327] on Test-NodeB-10318 09:58:40,982 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #41, conn_id=1) 09:58:40,982 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88327, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,983 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:40,983 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:40,983 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88327, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=1, TP: [cluster_name=ISPN] 09:58:40,983 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #41, conn_id=1) 09:58:40,983 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#41 09:58:40,983 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88327 09:58:40,983 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:40,983 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:40,983 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:40,983 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:40,983 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70513 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:40,983 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@4e66f781] 09:58:40,983 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:40,983 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70513 09:58:40,983 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70513 09:58:40,983 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70513 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70513 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70513 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88329] on Test-NodeA-7051 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #43, conn_id=0) 09:58:40,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88329, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 09:58:40,984 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (224 bytes (1120.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:40,984 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (227 bytes) 09:58:40,996 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=150 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88329, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 09:58:40,996 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #43, conn_id=0) 09:58:40,996 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#43 09:58:41,010 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88329 09:58:41,010 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:41,010 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:41,010 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,010 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:41,010 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70513 with [] suspected segments. 09:58:41,010 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:41,011 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:41,011 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 117, 247, 248, 252, 254, 127] 09:58:41,011 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:41,022 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88329 to Test-NodeB-10318 09:58:41,050 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #42, conn_id=1) 09:58:41,050 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88329, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,053 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,053 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-0 09:58:41,053 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:58:41,053 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:58:41,053 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:58:41,053 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:58:41,051 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:41,053 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:58:41,060 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:58:41,061 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [244, 251] 09:58:41,061 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,061 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-8 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:41,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:41,060 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:41,077 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88329, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,085 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #42, conn_id=1) 09:58:41,085 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#42 09:58:41,089 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:41,089 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:41,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:41,102 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #71) 09:58:41,102 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=71, conn_id=2, ts=22, TP: [cluster_name=ISPN] 09:58:41,102 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,102 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:41,106 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=71, conn_id=2, ts=22, TP: [cluster_name=ISPN] 09:58:41,107 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #71, conn-id=2, ts=22) 09:58:41,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88327 to Test-NodeA-7051 09:58:41,129 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #44, conn_id=0) 09:58:41,129 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88327, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 09:58:41,132 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,132 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:41,132 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88327, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 09:58:41,132 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #44, conn_id=0) 09:58:41,144 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#44 09:58:41,144 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:41,144 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:41,147 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70513 excluding keys [] 09:58:41,162 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,163 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:41,163 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:41,163 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:41,163 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88349] on Test-NodeC-52778 09:58:41,163 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #72, conn_id=2) 09:58:41,163 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88349, rsp_expected=true, UNICAST3: DATA, seqno=72, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,164 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:41,164 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:41,171 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88349, rsp_expected=true, UNICAST3: DATA, seqno=72, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,171 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #72, conn_id=2) 09:58:41,171 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#72 09:58:41,171 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88349 09:58:41,172 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:41,172 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:41,172 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,172 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:41,172 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70513 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:41,172 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@77d5bd7f] 09:58:41,172 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:41,172 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70513 09:58:41,136 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #43) 09:58:41,172 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=43, ts=24, TP: [cluster_name=ISPN] 09:58:41,172 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #74) 09:58:41,172 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=74, ts=25, TP: [cluster_name=ISPN] 09:58:41,173 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:41,173 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:41,173 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:41,173 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=43, ts=24, TP: [cluster_name=ISPN] 09:58:41,173 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #43, conn-id=0, ts=24) 09:58:41,173 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=74, ts=25, TP: [cluster_name=ISPN] 09:58:41,173 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #74, conn-id=0, ts=25) 09:58:41,172 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70513 09:58:41,174 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70513 09:58:41,178 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:41,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70513 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:41,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70513 09:58:41,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:41,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:41,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88351] on Test-NodeA-7051 09:58:41,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #75, conn_id=0) 09:58:41,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88351, rsp_expected=true, UNICAST3: DATA, seqno=75, TP: [cluster_name=ISPN] 09:58:41,181 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,181 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:41,182 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88351, rsp_expected=true, UNICAST3: DATA, seqno=75, TP: [cluster_name=ISPN] 09:58:41,183 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #75, conn_id=0) 09:58:41,183 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#75 09:58:41,183 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88351 09:58:41,183 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:41,183 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:41,183 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,183 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:41,183 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70513 with [] suspected segments. 09:58:41,183 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:41,183 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:41,183 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [129, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 180, 181, 60, 63, 67, 195, 69, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 103, 107, 108, 236, 239, 240, 113, 241, 245, 119, 120, 249, 122, 124, 253] 09:58:41,183 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70513 as completed! 09:58:41,183 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:41,183 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88351 to Test-NodeC-52778 09:58:41,184 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #73, conn_id=2) 09:58:41,184 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88351, rsp_expected=true, UNICAST3: DATA, seqno=73, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,184 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:41,184 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:41,184 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88351, rsp_expected=true, UNICAST3: DATA, seqno=73, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,199 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #73, conn_id=2) 09:58:41,199 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#73 09:58:41,199 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:41,199 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:41,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:41,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88349 to Test-NodeA-7051 09:58:41,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #76, conn_id=0) 09:58:41,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88349, rsp_expected=true, UNICAST3: DATA, seqno=76, TP: [cluster_name=ISPN] 09:58:41,201 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,210 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:41,210 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88349, rsp_expected=true, UNICAST3: DATA, seqno=76, TP: [cluster_name=ISPN] 09:58:41,211 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #76, conn_id=0) 09:58:41,233 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#76 09:58:41,236 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:41,242 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:41,249 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:41,250 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-70513 09:58:41,250 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:41,251 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:41,251 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [Test] Completed segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:41,251 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70513 09:58:41,251 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70513 being completed: true 09:58:41,251 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70513 09:58:41,251 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,251 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-1 09:58:41,251 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_complete_segment_invoked * 1 (available = 1, total = 1) 09:58:41,251 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_complete_segment_released * 1 09:58:41,251 TRACE (testng-Test:[]) [CheckPoint] Received event pre_complete_segment_invoked * 1 (available = 0, total = 1) 09:58:41,252 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@ecb1d38] 09:58:41,252 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:41,252 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-1'? true 09:58:41,252 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change-1 for owner=CommandInvocation:Test-NodeA-7051:35849. timeout=10000 (MILLISECONDS) 09:58:41,252 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35849. Timeout=10000 (MILLISECONDS) 09:58:41,252 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35849} 09:58:41,252 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35849}. Current=null 09:58:41,252 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35849}) => true 09:58:41,252 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35849}. WAITING => ACQUIRED 09:58:41,252 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35849} successfully acquired the lock. 09:58:41,252 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:41,252 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:58:41,252 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:41,252 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:41,252 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:58:41,252 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5409dd69){key=key-to-change-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:41,252 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,252 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,252 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:41,252 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,252 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:41,252 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:41,252 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88363] on Test-NodeB-10318 09:58:41,253 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #43, conn_id=1) 09:58:41,253 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88363, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,253 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (204 bytes (1020.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:41,253 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (207 bytes) 09:58:41,300 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=130 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88363, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,300 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #43, conn_id=1) 09:58:41,300 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#43 09:58:41,319 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88363 09:58:41,329 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:41,329 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:41,329 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,336 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,350 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1cd2b77] 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change-1'? false 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7696abf0){key=key-to-change-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7696abf0){key=key-to-change-1, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-1, value=new-value} in container 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88363 to Test-NodeA-7051 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #45, conn_id=0) 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88363, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster_name=ISPN] 09:58:41,351 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35849 09:58:41,354 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,354 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:41,358 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88363, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster_name=ISPN] 09:58:41,358 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #45, conn_id=0) 09:58:41,358 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#45 09:58:41,358 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:41,358 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:41,359 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5409dd69){key=key-to-change-1, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:41,359 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:58:41,359 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:41,359 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:41,359 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:41,359 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-1, value=new-value} in container 09:58:41,359 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,359 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change-1]. owner=CommandInvocation:Test-NodeA-7051:35849 09:58:41,359 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35849. 09:58:41,359 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35849}. ACQUIRED => RELEASED 09:58:41,359 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35849}? true 09:58:41,359 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35849} 09:58:41,359 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35849}, null) => true 09:58:41,359 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:41,359 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_complete_segment_released * 999999999 (available = 999999999, total = 999999999) 09:58:41,359 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_complete_segment_released * 1 (available = 999999998, total = 999999999) 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:41,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:41,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:41,360 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,360 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-4 09:58:41,360 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,361 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-3 09:58:41,361 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,361 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-2 09:58:41,361 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-9 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-7 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [48, 2, 229, 118, 71, 72, 233] 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-6 09:58:41,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:41,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:41,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:41,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:41,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:41,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:41,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [24] 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,362 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-5 09:58:41,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:41,373 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-1, value=new-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:41,384 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener ac5c67fc-dbc2-474f-8928-90453dfabef4 initial state for cache completed 09:58:41,384 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork runnable. 09:58:41,385 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@221c5fef[Not completed] to self 09:58:41,385 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@311e4827[Not completed] to remote execution at node Test-NodeB-10318 09:58:41,385 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@64594af5] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,385 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@64594af5], mode=SYNCHRONOUS, timeout=15000 09:58:41,385 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@64594af5] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:41,385 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88375] on Test-NodeB-10318 09:58:41,385 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #44, conn_id=1) 09:58:41,406 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88375, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,406 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5924f4c8[Not completed] to remote execution at node Test-NodeC-52778 09:58:41,407 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@64594af5] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,407 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@64594af5], mode=SYNCHRONOUS, timeout=15000 09:58:41,407 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@64594af5] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:41,407 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88379] on Test-NodeC-52778 09:58:41,407 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #74, conn_id=2) 09:58:41,407 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88379, rsp_expected=true, UNICAST3: DATA, seqno=74, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,407 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #43) 09:58:41,407 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=43, conn_id=1, ts=22, TP: [cluster_name=ISPN] 09:58:41,407 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (424 bytes (2120.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:41,407 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:41,407 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,407 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:41,407 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:41,412 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88375, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,414 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=43, conn_id=1, ts=22, TP: [cluster_name=ISPN] 09:58:41,414 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #43, conn-id=1, ts=22) 09:58:41,421 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88379, rsp_expected=true, UNICAST3: DATA, seqno=74, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,421 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #74, conn_id=2) 09:58:41,421 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#74 09:58:41,421 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88379 09:58:41,423 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2d8bf1b7] [sender=Test-NodeA-7051] 09:58:41,423 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:41,434 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2d8bf1b7] 09:58:41,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : ac5c67fc-dbc2-474f-8928-90453dfabef4 09:58:41,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2d8bf1b7] 09:58:41,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88379 to Test-NodeA-7051 09:58:41,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #77, conn_id=0) 09:58:41,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88379, rsp_expected=true, UNICAST3: DATA, seqno=77, TP: [cluster_name=ISPN] 09:58:41,436 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,436 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:41,445 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88379, rsp_expected=true, UNICAST3: DATA, seqno=77, TP: [cluster_name=ISPN] 09:58:41,445 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #77, conn_id=0) 09:58:41,413 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #44, conn_id=1) 09:58:41,446 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#44 09:58:41,445 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#77 09:58:41,446 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:41,446 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@64594af5] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:41,446 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88375 09:58:41,453 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5539b8ef] [sender=Test-NodeA-7051] 09:58:41,517 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:41,517 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,518 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5539b8ef] 09:58:41,539 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : ac5c67fc-dbc2-474f-8928-90453dfabef4 09:58:41,539 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5539b8ef] 09:58:41,539 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88375 to Test-NodeA-7051 09:58:41,540 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #46, conn_id=0) 09:58:41,557 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88375, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster_name=ISPN] 09:58:41,559 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,559 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:41,559 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88375, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster_name=ISPN] 09:58:41,559 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #46, conn_id=0) 09:58:41,559 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#46 09:58:41,559 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:41,559 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@64594af5] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:41,561 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganAndSegmentNotCompleteValueOwnerClustered 09:58:41,561 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:41,561 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:41,561 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:41,561 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:41,561 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:41,561 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:41,561 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:41,561 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:41,561 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:41,561 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:41,561 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:41,562 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:41,562 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:41,562 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:41,562 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganButNotIteratedValueYetNonOwnerClustered 09:58:41,562 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@53fbabcd] 09:58:41,562 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:41,563 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:41,563 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:41,563 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:41,563 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,563 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,563 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:41,563 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,563 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:41,563 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:41,563 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88390] on Test-NodeB-10318 09:58:41,563 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #45, conn_id=1) 09:58:41,563 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88390, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,563 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:41,563 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:41,564 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88390, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,564 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #45, conn_id=1) 09:58:41,564 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#45 09:58:41,564 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88390 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35855. timeout=10000 (MILLISECONDS) 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35855. Timeout=10000 (MILLISECONDS) 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35855} 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35855}. Current=null 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35855}) => true 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35855}. WAITING => ACQUIRED 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35855} successfully acquired the lock. 09:58:41,587 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:41,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@48eb33d1] 09:58:41,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:41,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:41,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35855. timeout=10000 (MILLISECONDS) 09:58:41,588 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35855. Timeout=10000 (MILLISECONDS) 09:58:41,591 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35855} 09:58:41,602 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #74) 09:58:41,602 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=74, conn_id=2, ts=23, TP: [cluster_name=ISPN] 09:58:41,602 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,602 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:41,602 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=74, conn_id=2, ts=23, TP: [cluster_name=ISPN] 09:58:41,602 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #74, conn-id=2, ts=23) 09:58:41,591 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:41,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:41,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:41,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:41,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:41,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7dba6b1c){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:41,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:41,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:41,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88395] on Test-NodeC-52778 09:58:41,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #19, conn_id=1) 09:58:41,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88395, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,619 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:41,619 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:41,619 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88395, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,673 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #46) 09:58:41,673 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=46, ts=26, TP: [cluster_name=ISPN] 09:58:41,673 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #77) 09:58:41,673 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=77, ts=27, TP: [cluster_name=ISPN] 09:58:41,673 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:41,653 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #19, conn_id=1) 09:58:41,680 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#19 09:58:41,680 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88395 09:58:41,680 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:41,673 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:41,683 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:41,683 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=46, ts=26, TP: [cluster_name=ISPN] 09:58:41,687 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #46, conn-id=0, ts=26) 09:58:41,683 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=77, ts=27, TP: [cluster_name=ISPN] 09:58:41,688 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #77, conn-id=0, ts=27) 09:58:41,680 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:41,689 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,689 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,717 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:41,717 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@23c88cac] 09:58:41,717 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:41,717 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4e702c91){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4e702c91){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88395 to Test-NodeB-10318 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #19, conn_id=1) 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88395, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35855 09:58:41,718 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:41,718 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:41,720 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88395, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,720 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #19, conn_id=1) 09:58:41,720 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#19 09:58:41,720 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:41,720 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7dba6b1c){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35855 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35855. 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35855}. ACQUIRED => RELEASED 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35855}? true 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35855} 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35855}, null) => true 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88390 to Test-NodeA-7051 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #47, conn_id=0) 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88390, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster_name=ISPN] 09:58:41,721 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35855 09:58:41,721 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,721 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:41,722 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88390, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster_name=ISPN] 09:58:41,722 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #47, conn_id=0) 09:58:41,722 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#47 09:58:41,722 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:41,722 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:41,723 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,723 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@237c8801] 09:58:41,723 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:41,723 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:41,723 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:41,723 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:41,723 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,723 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,723 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:41,723 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,723 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:41,723 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:41,723 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88406] on Test-NodeC-52778 09:58:41,723 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #75, conn_id=2) 09:58:41,723 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88406, rsp_expected=true, UNICAST3: DATA, seqno=75, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,723 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:41,723 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:41,723 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88406, rsp_expected=true, UNICAST3: DATA, seqno=75, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,723 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #75, conn_id=2) 09:58:41,723 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#75 09:58:41,723 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88406 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35860. timeout=10000 (MILLISECONDS) 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35860. Timeout=10000 (MILLISECONDS) 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35860} 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35860}. Current=null 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35860}) => true 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35860}. WAITING => ACQUIRED 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35860} successfully acquired the lock. 09:58:41,724 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@59bf0ec6] 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:35860. timeout=10000 (MILLISECONDS) 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35860. Timeout=10000 (MILLISECONDS) 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35860} 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5b58916c){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:41,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:41,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88407] on Test-NodeA-7051 09:58:41,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #78, conn_id=0) 09:58:41,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88407, rsp_expected=true, UNICAST3: DATA, seqno=78, TP: [cluster_name=ISPN] 09:58:41,727 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,738 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:41,754 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88407, rsp_expected=true, UNICAST3: DATA, seqno=78, TP: [cluster_name=ISPN] 09:58:41,754 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #78, conn_id=0) 09:58:41,754 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#78 09:58:41,754 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88407 09:58:41,754 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:41,754 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:41,754 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,754 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:41,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3e41bcde] 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(11c3f143){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:41,773 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(11c3f143){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88407 to Test-NodeC-52778 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #76, conn_id=2) 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88407, rsp_expected=true, UNICAST3: DATA, seqno=76, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,784 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35860 09:58:41,784 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:41,833 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:41,833 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88407, rsp_expected=true, UNICAST3: DATA, seqno=76, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,833 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #76, conn_id=2) 09:58:41,833 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#76 09:58:41,833 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:41,833 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:41,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5b58916c){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:41,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:41,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:41,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:41,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:41,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35860 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35860. 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35860}. ACQUIRED => RELEASED 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35860}? true 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35860} 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35860}, null) => true 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88406 to Test-NodeA-7051 09:58:41,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #79, conn_id=0) 09:58:41,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88406, rsp_expected=true, UNICAST3: DATA, seqno=79, TP: [cluster_name=ISPN] 09:58:41,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:35860 09:58:41,840 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,840 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:41,840 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88406, rsp_expected=true, UNICAST3: DATA, seqno=79, TP: [cluster_name=ISPN] 09:58:41,841 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #79, conn_id=0) 09:58:41,841 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#79 09:58:41,841 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:41,841 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:41,841 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,850 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@29cd5eba] 09:58:41,850 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:41,850 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:41,850 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:41,851 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:41,851 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,851 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,851 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:41,851 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,851 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:41,851 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:41,851 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88432] on Test-NodeC-52778 09:58:41,871 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #77, conn_id=2) 09:58:41,871 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88432, rsp_expected=true, UNICAST3: DATA, seqno=77, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,872 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:41,872 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88432, rsp_expected=true, UNICAST3: DATA, seqno=77, conn_id=2, TP: [cluster_name=ISPN] 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #77, conn_id=2) 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#77 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88432 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35873. timeout=10000 (MILLISECONDS) 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35873. Timeout=10000 (MILLISECONDS) 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35873} 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35873}. Current=null 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35873}) => true 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35873}. WAITING => ACQUIRED 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35873} successfully acquired the lock. 09:58:41,872 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,873 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:41,873 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5f1951dc] 09:58:41,873 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:41,873 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:35873. timeout=10000 (MILLISECONDS) 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35873. Timeout=10000 (MILLISECONDS) 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35873} 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(14d4d43){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88437] on Test-NodeB-10318 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #20, conn_id=1) 09:58:41,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88437, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,888 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:41,888 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:41,889 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88437, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 09:58:41,903 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #20, conn_id=1) 09:58:41,903 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#20 09:58:41,903 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88437 09:58:41,903 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:41,903 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:41,903 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:41,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:41,944 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #45) 09:58:41,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5b4593f8] 09:58:41,962 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:41,962 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:41,962 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:41,964 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:41,962 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=45, conn_id=1, ts=23, TP: [cluster_name=ISPN] 09:58:41,968 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:41,964 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(45b83bf8){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(45b83bf8){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:41,969 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:41,968 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:41,968 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #20) 09:58:41,978 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=20, conn_id=1, ts=24, TP: [cluster_name=ISPN] 09:58:41,978 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=45, conn_id=1, ts=23, TP: [cluster_name=ISPN] 09:58:41,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:41,979 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:41,979 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:41,979 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:41,979 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88437 to Test-NodeC-52778 09:58:41,979 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #45, conn-id=1, ts=23) 09:58:41,979 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:41,981 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:41,991 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=20, conn_id=1, ts=24, TP: [cluster_name=ISPN] 09:58:41,991 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #20, conn-id=1, ts=24) 09:58:41,991 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #20, conn_id=1) 09:58:41,995 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88437, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,001 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,001 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:42,001 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88437, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,001 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #20, conn_id=1) 09:58:42,001 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35873 09:58:42,001 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#20 09:58:42,012 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,012 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:42,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(14d4d43){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:42,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,028 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:42,028 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:42,030 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35873 09:58:42,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35873. 09:58:42,036 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35873}. ACQUIRED => RELEASED 09:58:42,036 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35873}? true 09:58:42,037 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35873} 09:58:42,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35873}, null) => true 09:58:42,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:42,084 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88432 to Test-NodeA-7051 09:58:42,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #80, conn_id=0) 09:58:42,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88432, rsp_expected=true, UNICAST3: DATA, seqno=80, TP: [cluster_name=ISPN] 09:58:42,089 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:35873 09:58:42,089 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,102 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #20) 09:58:42,102 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=20, conn_id=1, ts=24, TP: [cluster_name=ISPN] 09:58:42,102 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #77) 09:58:42,102 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=77, conn_id=2, ts=25, TP: [cluster_name=ISPN] 09:58:42,101 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:42,103 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88432, rsp_expected=true, UNICAST3: DATA, seqno=80, TP: [cluster_name=ISPN] 09:58:42,103 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:42,105 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:42,105 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:42,106 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=77, conn_id=2, ts=25, TP: [cluster_name=ISPN] 09:58:42,106 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=20, conn_id=1, ts=24, TP: [cluster_name=ISPN] 09:58:42,105 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #80, conn_id=0) 09:58:42,110 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #20, conn-id=1, ts=24) 09:58:42,110 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#80 09:58:42,110 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #77, conn-id=2, ts=25) 09:58:42,110 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,131 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:42,131 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,133 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@14b25c50] 09:58:42,136 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:42,137 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:42,137 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:42,137 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:42,137 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,137 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,137 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:42,137 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,137 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,137 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:42,137 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88464] on Test-NodeC-52778 09:58:42,137 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #78, conn_id=2) 09:58:42,137 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88464, rsp_expected=true, UNICAST3: DATA, seqno=78, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,140 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,140 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:42,141 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88464, rsp_expected=true, UNICAST3: DATA, seqno=78, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #78, conn_id=2) 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#78 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88464 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35882. timeout=10000 (MILLISECONDS) 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35882. Timeout=10000 (MILLISECONDS) 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35882} 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35882}. Current=null 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35882}) => true 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35882}. WAITING => ACQUIRED 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35882} successfully acquired the lock. 09:58:42,142 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,142 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,142 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,142 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@34dbd659] 09:58:42,143 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,143 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:42,143 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:35882. timeout=10000 (MILLISECONDS) 09:58:42,143 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35882. Timeout=10000 (MILLISECONDS) 09:58:42,143 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35882} 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(8657ae3){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88465] on Test-NodeB-10318 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #21, conn_id=1) 09:58:42,144 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88465, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,144 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:42,144 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:42,144 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88465, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,144 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #21, conn_id=1) 09:58:42,144 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#21 09:58:42,145 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88465 09:58:42,145 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:42,145 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,145 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1686ae5c] 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5d1072d8){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5d1072d8){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88465 to Test-NodeC-52778 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #21, conn_id=1) 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88465, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,145 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35882 09:58:42,145 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,170 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:42,171 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88465, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,173 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #47) 09:58:42,173 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=47, ts=28, TP: [cluster_name=ISPN] 09:58:42,173 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #80) 09:58:42,173 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=80, ts=29, TP: [cluster_name=ISPN] 09:58:42,173 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:42,179 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:42,179 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,179 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:42,181 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=80, ts=29, TP: [cluster_name=ISPN] 09:58:42,181 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #80, conn-id=0, ts=29) 09:58:42,172 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #21, conn_id=1) 09:58:42,182 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#21 09:58:42,182 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,182 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:42,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(8657ae3){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:42,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,179 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=47, ts=28, TP: [cluster_name=ISPN] 09:58:42,189 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #47, conn-id=0, ts=28) 09:58:42,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:42,190 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:42,191 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,194 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35882 09:58:42,194 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35882. 09:58:42,195 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35882}. ACQUIRED => RELEASED 09:58:42,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35882}? true 09:58:42,197 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35882} 09:58:42,198 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35882}, null) => true 09:58:42,201 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:42,204 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,205 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88464 to Test-NodeA-7051 09:58:42,205 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #81, conn_id=0) 09:58:42,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88464, rsp_expected=true, UNICAST3: DATA, seqno=81, TP: [cluster_name=ISPN] 09:58:42,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:35882 09:58:42,210 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,210 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:42,210 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88464, rsp_expected=true, UNICAST3: DATA, seqno=81, TP: [cluster_name=ISPN] 09:58:42,212 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #81, conn_id=0) 09:58:42,212 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#81 09:58:42,218 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,218 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:42,218 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,219 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@182b83a3] 09:58:42,231 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:42,232 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:42,232 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:42,232 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:42,232 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,232 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,232 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:42,232 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,232 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,232 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:42,232 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88478] on Test-NodeC-52778 09:58:42,232 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #79, conn_id=2) 09:58:42,254 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88478, rsp_expected=true, UNICAST3: DATA, seqno=79, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,254 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,254 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:42,256 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88478, rsp_expected=true, UNICAST3: DATA, seqno=79, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,262 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #79, conn_id=2) 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#79 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88478 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35885. timeout=10000 (MILLISECONDS) 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35885. Timeout=10000 (MILLISECONDS) 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35885} 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35885}. Current=null 09:58:42,263 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35885}) => true 09:58:42,275 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35885}. WAITING => ACQUIRED 09:58:42,275 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35885} successfully acquired the lock. 09:58:42,275 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@98202a9] 09:58:42,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:42,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:35885. timeout=10000 (MILLISECONDS) 09:58:42,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35885. Timeout=10000 (MILLISECONDS) 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35885} 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(66c02eaa){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88488] on Test-NodeA-7051 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #82, conn_id=0) 09:58:42,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88488, rsp_expected=true, UNICAST3: DATA, seqno=82, TP: [cluster_name=ISPN] 09:58:42,276 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,279 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:42,281 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88488, rsp_expected=true, UNICAST3: DATA, seqno=82, TP: [cluster_name=ISPN] 09:58:42,281 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #82, conn_id=0) 09:58:42,281 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#82 09:58:42,281 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88488 09:58:42,281 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:42,281 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,281 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,281 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@54bdc4cc] 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(22e01c56){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(22e01c56){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88488 to Test-NodeC-52778 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #80, conn_id=2) 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88488, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,294 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35885 09:58:42,294 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,294 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:42,294 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88488, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,294 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #80, conn_id=2) 09:58:42,295 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#80 09:58:42,295 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,295 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:42,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(66c02eaa){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:42,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,298 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:42,298 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:42,298 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,298 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35885 09:58:42,298 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35885. 09:58:42,298 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35885}. ACQUIRED => RELEASED 09:58:42,299 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35885}? true 09:58:42,299 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35885} 09:58:42,299 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35885}, null) => true 09:58:42,299 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:42,312 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,313 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88478 to Test-NodeA-7051 09:58:42,313 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #83, conn_id=0) 09:58:42,313 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88478, rsp_expected=true, UNICAST3: DATA, seqno=83, TP: [cluster_name=ISPN] 09:58:42,313 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:35885 09:58:42,313 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,314 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:42,346 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88478, rsp_expected=true, UNICAST3: DATA, seqno=83, TP: [cluster_name=ISPN] 09:58:42,346 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #83, conn_id=0) 09:58:42,346 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#83 09:58:42,346 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,346 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:42,346 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,346 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@c037371] 09:58:42,346 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:42,346 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:42,346 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:35892. timeout=10000 (MILLISECONDS) 09:58:42,346 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35892. Timeout=10000 (MILLISECONDS) 09:58:42,346 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35892} 09:58:42,347 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35892}. Current=null 09:58:42,352 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35892}) => true 09:58:42,368 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35892}. WAITING => ACQUIRED 09:58:42,368 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35892} successfully acquired the lock. 09:58:42,372 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:42,372 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:42,372 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,383 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,383 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:42,383 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5d8c19fc){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,395 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,420 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,420 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:42,423 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,423 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,423 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:42,423 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88508] on Test-NodeB-10318 09:58:42,424 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #46, conn_id=1) 09:58:42,430 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88508, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,430 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:42,430 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:42,430 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88508, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,430 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #46, conn_id=1) 09:58:42,430 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#46 09:58:42,430 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88508 09:58:42,430 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:42,430 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,430 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,431 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,435 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2abde0d1] 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2e5e6985){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2e5e6985){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88508 to Test-NodeA-7051 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #48, conn_id=0) 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88508, rsp_expected=true, UNICAST3: DATA, seqno=48, TP: [cluster_name=ISPN] 09:58:42,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35892 09:58:42,452 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,452 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:42,452 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88508, rsp_expected=true, UNICAST3: DATA, seqno=48, TP: [cluster_name=ISPN] 09:58:42,453 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #48, conn_id=0) 09:58:42,453 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#48 09:58:42,453 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,453 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:42,453 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5d8c19fc){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,453 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:42,453 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,453 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,453 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:42,453 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:42,453 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,453 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:35892 09:58:42,453 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35892. 09:58:42,453 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35892}. ACQUIRED => RELEASED 09:58:42,453 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35892}? true 09:58:42,453 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35892} 09:58:42,454 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35892}, null) => true 09:58:42,454 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:42,454 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@13b4f549] 09:58:42,454 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:42,454 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:42,454 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:42,454 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:42,454 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,454 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,454 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:42,454 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,454 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,454 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:42,454 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88515] on Test-NodeC-52778 09:58:42,454 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #81, conn_id=2) 09:58:42,454 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88515, rsp_expected=true, UNICAST3: DATA, seqno=81, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,455 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,455 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88515, rsp_expected=true, UNICAST3: DATA, seqno=81, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #81, conn_id=2) 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#81 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88515 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35901. timeout=10000 (MILLISECONDS) 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35901. Timeout=10000 (MILLISECONDS) 09:58:42,455 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35901} 09:58:42,468 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35901}. Current=null 09:58:42,470 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35901}) => true 09:58:42,473 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35901}. WAITING => ACQUIRED 09:58:42,475 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35901} successfully acquired the lock. 09:58:42,485 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #46) 09:58:42,485 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=46, conn_id=1, ts=25, TP: [cluster_name=ISPN] 09:58:42,485 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,485 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,486 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #21) 09:58:42,486 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,486 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,486 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=21, conn_id=1, ts=26, TP: [cluster_name=ISPN] 09:58:42,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7c24a72f] 09:58:42,488 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:42,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:42,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:35901. timeout=10000 (MILLISECONDS) 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35901. Timeout=10000 (MILLISECONDS) 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35901} 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4162af48){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88526] on Test-NodeA-7051 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #84, conn_id=0) 09:58:42,490 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88526, rsp_expected=true, UNICAST3: DATA, seqno=84, TP: [cluster_name=ISPN] 09:58:42,490 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=46, conn_id=1, ts=25, TP: [cluster_name=ISPN] 09:58:42,490 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #46, conn-id=1, ts=25) 09:58:42,490 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,490 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:42,491 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88526, rsp_expected=true, UNICAST3: DATA, seqno=84, TP: [cluster_name=ISPN] 09:58:42,492 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,495 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:42,495 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=21, conn_id=1, ts=26, TP: [cluster_name=ISPN] 09:58:42,495 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #21, conn-id=1, ts=26) 09:58:42,491 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #84, conn_id=0) 09:58:42,495 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#84 09:58:42,504 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88526 09:58:42,506 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:42,506 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,659 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,654 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #21) 09:58:42,660 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=21, conn_id=1, ts=26, TP: [cluster_name=ISPN] 09:58:42,659 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,666 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,666 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@11f4e398] 09:58:42,666 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,666 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:42,666 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:42,666 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:42,666 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1fb3410c){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1fb3410c){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,668 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:42,669 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:42,669 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=21, conn_id=1, ts=26, TP: [cluster_name=ISPN] 09:58:42,673 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #48) 09:58:42,673 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=48, ts=30, TP: [cluster_name=ISPN] 09:58:42,673 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #84) 09:58:42,673 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:42,673 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=84, ts=31, TP: [cluster_name=ISPN] 09:58:42,673 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:42,673 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,673 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:42,673 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=48, ts=30, TP: [cluster_name=ISPN] 09:58:42,673 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #48, conn-id=0, ts=30) 09:58:42,674 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=84, ts=31, TP: [cluster_name=ISPN] 09:58:42,674 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #84, conn-id=0, ts=31) 09:58:42,669 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #21, conn-id=1, ts=26) 09:58:42,668 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #81) 09:58:42,667 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,687 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:42,687 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:42,687 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,687 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,687 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88526 to Test-NodeC-52778 09:58:42,687 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #82, conn_id=2) 09:58:42,687 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88526, rsp_expected=true, UNICAST3: DATA, seqno=82, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,687 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35901 09:58:42,687 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,686 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=81, conn_id=2, ts=27, TP: [cluster_name=ISPN] 09:58:42,688 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,688 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:42,688 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=81, conn_id=2, ts=27, TP: [cluster_name=ISPN] 09:58:42,688 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #81, conn-id=2, ts=27) 09:58:42,688 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:42,692 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88526, rsp_expected=true, UNICAST3: DATA, seqno=82, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,693 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #82, conn_id=2) 09:58:42,693 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#82 09:58:42,693 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,693 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:42,693 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4162af48){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,693 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:42,693 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,693 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,693 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:42,693 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:42,702 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,702 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35901 09:58:42,702 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35901. 09:58:42,702 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35901}. ACQUIRED => RELEASED 09:58:42,705 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35901}? true 09:58:42,705 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35901} 09:58:42,708 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35901}, null) => true 09:58:42,708 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:42,708 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,708 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88515 to Test-NodeA-7051 09:58:42,708 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #85, conn_id=0) 09:58:42,708 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88515, rsp_expected=true, UNICAST3: DATA, seqno=85, TP: [cluster_name=ISPN] 09:58:42,708 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:35901 09:58:42,708 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,708 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:42,708 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88515, rsp_expected=true, UNICAST3: DATA, seqno=85, TP: [cluster_name=ISPN] 09:58:42,708 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #85, conn_id=0) 09:58:42,708 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#85 09:58:42,708 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,708 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:42,713 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,713 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@bccac96] 09:58:42,713 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:42,713 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:42,713 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:42,721 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:42,721 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,721 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,721 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:42,721 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,721 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,721 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:42,721 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88540] on Test-NodeC-52778 09:58:42,721 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #83, conn_id=2) 09:58:42,721 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88540, rsp_expected=true, UNICAST3: DATA, seqno=83, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,721 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,722 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88540, rsp_expected=true, UNICAST3: DATA, seqno=83, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #83, conn_id=2) 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#83 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88540 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35908. timeout=10000 (MILLISECONDS) 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35908. Timeout=10000 (MILLISECONDS) 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35908} 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35908}. Current=null 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35908}) => true 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35908}. WAITING => ACQUIRED 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35908} successfully acquired the lock. 09:58:42,722 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4619bd2c] 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:35908. timeout=10000 (MILLISECONDS) 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35908. Timeout=10000 (MILLISECONDS) 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35908} 09:58:42,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:42,753 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:42,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3e72e64a){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88545] on Test-NodeA-7051 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #86, conn_id=0) 09:58:42,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88545, rsp_expected=true, UNICAST3: DATA, seqno=86, TP: [cluster_name=ISPN] 09:58:42,769 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,769 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:42,769 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88545, rsp_expected=true, UNICAST3: DATA, seqno=86, TP: [cluster_name=ISPN] 09:58:42,769 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #86, conn_id=0) 09:58:42,780 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#86 09:58:42,780 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88545 09:58:42,780 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:42,785 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,785 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,785 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,792 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@25927d92] 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(732c7da){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,804 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(732c7da){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,804 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:42,804 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,808 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,808 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:42,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:42,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88545 to Test-NodeC-52778 09:58:42,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #84, conn_id=2) 09:58:42,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88545, rsp_expected=true, UNICAST3: DATA, seqno=84, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35908 09:58:42,818 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,819 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:42,819 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88545, rsp_expected=true, UNICAST3: DATA, seqno=84, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,819 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #84, conn_id=2) 09:58:42,819 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#84 09:58:42,819 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,819 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3e72e64a){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35908 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35908. 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35908}. ACQUIRED => RELEASED 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35908}? true 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35908} 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35908}, null) => true 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88540 to Test-NodeA-7051 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #87, conn_id=0) 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88540, rsp_expected=true, UNICAST3: DATA, seqno=87, TP: [cluster_name=ISPN] 09:58:42,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:35908 09:58:42,819 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,819 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:42,820 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88540, rsp_expected=true, UNICAST3: DATA, seqno=87, TP: [cluster_name=ISPN] 09:58:42,820 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #87, conn_id=0) 09:58:42,820 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#87 09:58:42,820 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,820 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:42,820 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,820 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21eddeca] 09:58:42,820 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:42,820 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:42,820 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:42,820 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:42,820 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,821 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,821 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:42,821 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,821 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,821 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:42,821 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88554] on Test-NodeB-10318 09:58:42,821 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #47, conn_id=1) 09:58:42,821 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88554, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,822 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:42,822 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:42,824 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88554, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,828 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #47, conn_id=1) 09:58:42,841 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#47 09:58:42,841 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88554 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35914. timeout=10000 (MILLISECONDS) 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35914. Timeout=10000 (MILLISECONDS) 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35914} 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35914}. Current=null 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35914}) => true 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35914}. WAITING => ACQUIRED 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35914} successfully acquired the lock. 09:58:42,842 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@d09d65c] 09:58:42,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,854 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:42,854 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:35914. timeout=10000 (MILLISECONDS) 09:58:42,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35914. Timeout=10000 (MILLISECONDS) 09:58:42,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35914} 09:58:42,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:42,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:42,866 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,866 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,879 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:42,879 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(53d1f397){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,879 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,879 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,879 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,880 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,880 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:42,880 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88566] on Test-NodeC-52778 09:58:42,880 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #22, conn_id=1) 09:58:42,880 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88566, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,880 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,880 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:42,880 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88566, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,884 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #22, conn_id=1) 09:58:42,884 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#22 09:58:42,884 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88566 09:58:42,884 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:42,884 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,884 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,885 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5f74ec0d] 09:58:42,885 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,885 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:42,887 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:42,888 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:42,898 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,898 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,898 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:42,898 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5640cc95){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,898 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,898 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,906 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5640cc95){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:42,914 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,914 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,914 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:42,915 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:42,915 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,917 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,920 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88566 to Test-NodeB-10318 09:58:42,939 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #22, conn_id=1) 09:58:42,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88566, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35914 09:58:42,942 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:42,947 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:42,949 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88566, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 09:58:42,949 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #22, conn_id=1) 09:58:42,949 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#22 09:58:42,950 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,950 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(53d1f397){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35914 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35914. 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35914}. ACQUIRED => RELEASED 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35914}? true 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35914} 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35914}, null) => true 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88554 to Test-NodeA-7051 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #49, conn_id=0) 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88554, rsp_expected=true, UNICAST3: DATA, seqno=49, TP: [cluster_name=ISPN] 09:58:42,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:35914 09:58:42,951 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,951 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:42,952 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88554, rsp_expected=true, UNICAST3: DATA, seqno=49, TP: [cluster_name=ISPN] 09:58:42,952 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #49, conn_id=0) 09:58:42,952 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#49 09:58:42,952 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:42,952 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:42,952 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,952 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@304de722] 09:58:42,952 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:42,952 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:42,952 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:42,952 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:42,952 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,952 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,952 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:42,952 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,952 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,952 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:42,952 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88579] on Test-NodeC-52778 09:58:42,952 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #85, conn_id=2) 09:58:42,952 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88579, rsp_expected=true, UNICAST3: DATA, seqno=85, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,952 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:42,952 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:42,952 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88579, rsp_expected=true, UNICAST3: DATA, seqno=85, conn_id=2, TP: [cluster_name=ISPN] 09:58:42,952 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #85, conn_id=2) 09:58:42,952 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#85 09:58:42,952 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88579 09:58:42,952 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35923. timeout=10000 (MILLISECONDS) 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35923. Timeout=10000 (MILLISECONDS) 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35923} 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35923}. Current=null 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35923}) => true 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35923}. WAITING => ACQUIRED 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35923} successfully acquired the lock. 09:58:42,953 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@39b15f67] 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:35923. timeout=10000 (MILLISECONDS) 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35923. Timeout=10000 (MILLISECONDS) 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35923} 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3a32ae26){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88580] on Test-NodeA-7051 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #88, conn_id=0) 09:58:42,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88580, rsp_expected=true, UNICAST3: DATA, seqno=88, TP: [cluster_name=ISPN] 09:58:42,953 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:42,953 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:42,953 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88580, rsp_expected=true, UNICAST3: DATA, seqno=88, TP: [cluster_name=ISPN] 09:58:42,953 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #88, conn_id=0) 09:58:42,953 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#88 09:58:42,953 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88580 09:58:42,953 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:42,953 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:42,953 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@316c0c87] 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(34528087){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(34528087){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:42,955 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:42,977 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:42,991 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #47) 09:58:42,991 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=47, conn_id=1, ts=27, TP: [cluster_name=ISPN] 09:58:42,991 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #22) 09:58:42,991 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=22, conn_id=1, ts=28, TP: [cluster_name=ISPN] 09:58:42,994 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:42,994 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:42,994 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:42,994 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:42,991 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:42,995 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:42,994 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,001 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88580 to Test-NodeC-52778 09:58:43,001 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #86, conn_id=2) 09:58:43,001 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88580, rsp_expected=true, UNICAST3: DATA, seqno=86, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,001 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=22, conn_id=1, ts=28, TP: [cluster_name=ISPN] 09:58:43,001 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #22, conn-id=1, ts=28) 09:58:43,001 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:43,002 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=47, conn_id=1, ts=27, TP: [cluster_name=ISPN] 09:58:43,003 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #47, conn-id=1, ts=27) 09:58:43,002 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,002 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35923 09:58:43,006 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:43,006 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88580, rsp_expected=true, UNICAST3: DATA, seqno=86, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,014 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #86, conn_id=2) 09:58:43,014 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#86 09:58:43,014 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,014 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:43,014 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3a32ae26){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:43,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:43,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:43,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:43,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:43,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:43,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35923 09:58:43,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35923. 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35923}. ACQUIRED => RELEASED 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35923}? true 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35923} 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35923}, null) => true 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88579 to Test-NodeA-7051 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #89, conn_id=0) 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88579, rsp_expected=true, UNICAST3: DATA, seqno=89, TP: [cluster_name=ISPN] 09:58:43,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:35923 09:58:43,021 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,022 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:43,031 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88579, rsp_expected=true, UNICAST3: DATA, seqno=89, TP: [cluster_name=ISPN] 09:58:43,033 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #89, conn_id=0) 09:58:43,033 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#89 09:58:43,048 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,062 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:43,063 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,066 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:43,076 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:43,079 DEBUG (testng-Test:[]) [Test] Found key key-to-change1 with primary owner != Test-NodeA-7051, segment 184 09:58:43,079 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:43,079 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_invoked * 1 09:58:43,080 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 62596a7d-4380-4aa7-8741-a6ffa97d3275 09:58:43,080 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5130b5e8[Not completed] to remote execution at node Test-NodeB-10318 09:58:43,080 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@62add2db] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,080 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@62add2db], mode=SYNCHRONOUS, timeout=15000 09:58:43,080 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@62add2db] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:43,080 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88601] on Test-NodeB-10318 09:58:43,080 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #48, conn_id=1) 09:58:43,080 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88601, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,086 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,086 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:43,086 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@319da330[Not completed] to remote execution at node Test-NodeC-52778 09:58:43,086 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@62add2db] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,086 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@62add2db], mode=SYNCHRONOUS, timeout=15000 09:58:43,086 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@62add2db] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:43,086 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88604] on Test-NodeC-52778 09:58:43,087 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #87, conn_id=2) 09:58:43,087 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88604, rsp_expected=true, UNICAST3: DATA, seqno=87, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,087 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,087 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:43,090 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88604, rsp_expected=true, UNICAST3: DATA, seqno=87, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,090 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #87, conn_id=2) 09:58:43,090 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#87 09:58:43,090 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88604 09:58:43,087 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88601, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,092 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #48, conn_id=1) 09:58:43,093 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#48 09:58:43,093 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88601 09:58:43,093 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7882dc47] [sender=Test-NodeA-7051] 09:58:43,093 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:43,093 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,093 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7882dc47] 09:58:43,090 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@14338793] [sender=Test-NodeA-7051] 09:58:43,093 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:43,093 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 62596a7d-4380-4aa7-8741-a6ffa97d3275 09:58:43,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7882dc47] 09:58:43,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88601 to Test-NodeA-7051 09:58:43,096 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@14338793] 09:58:43,096 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,096 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #50, conn_id=0) 09:58:43,097 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88601, rsp_expected=true, UNICAST3: DATA, seqno=50, TP: [cluster_name=ISPN] 09:58:43,097 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,097 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 62596a7d-4380-4aa7-8741-a6ffa97d3275 09:58:43,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@14338793] 09:58:43,105 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:43,105 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88601, rsp_expected=true, UNICAST3: DATA, seqno=50, TP: [cluster_name=ISPN] 09:58:43,106 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #50, conn_id=0) 09:58:43,106 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#50 09:58:43,106 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,104 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88604 to Test-NodeA-7051 09:58:43,106 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #90, conn_id=0) 09:58:43,107 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88604, rsp_expected=true, UNICAST3: DATA, seqno=90, TP: [cluster_name=ISPN] 09:58:43,106 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@62add2db] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:43,115 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,117 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:43,117 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88604, rsp_expected=true, UNICAST3: DATA, seqno=90, TP: [cluster_name=ISPN] 09:58:43,119 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #90, conn_id=0) 09:58:43,119 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#90 09:58:43,121 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,121 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@62add2db] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:43,121 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 62596a7d-4380-4aa7-8741-a6ffa97d3275 requests initial state for cache 09:58:43,126 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@3e68b201] 09:58:43,129 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:43,131 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_invoked * 1 (available = 1, total = 1) 09:58:43,131 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_released * 1 09:58:43,131 TRACE (testng-Test:[]) [CheckPoint] Received event pre_retrieve_entry_invoked * 1 (available = 0, total = 1) 09:58:43,131 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5ca6c372] 09:58:43,131 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:43,186 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:43,187 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:43,187 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:58:43,187 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,187 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,187 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:43,187 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,187 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:43,187 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:43,187 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88616] on Test-NodeB-10318 09:58:43,187 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #49, conn_id=1) 09:58:43,187 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88616, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,187 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (203 bytes (1015.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,188 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #22) 09:58:43,187 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (206 bytes) 09:58:43,182 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #50) 09:58:43,195 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=50, ts=32, TP: [cluster_name=ISPN] 09:58:43,201 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,201 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:43,202 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=129 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88616, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,202 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #49, conn_id=1) 09:58:43,202 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#49 09:58:43,203 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=50, ts=32, TP: [cluster_name=ISPN] 09:58:43,213 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #50, conn-id=0, ts=32) 09:58:43,202 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88616 09:58:43,202 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=22, conn_id=1, ts=28, TP: [cluster_name=ISPN] 09:58:43,216 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #87) 09:58:43,216 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,216 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:43,216 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=22, conn_id=1, ts=28, TP: [cluster_name=ISPN] 09:58:43,216 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #22, conn-id=1, ts=28) 09:58:43,197 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #90) 09:58:43,218 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=90, ts=33, TP: [cluster_name=ISPN] 09:58:43,218 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,218 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:43,218 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=90, ts=33, TP: [cluster_name=ISPN] 09:58:43,218 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #90, conn-id=0, ts=33) 09:58:43,216 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=87, conn_id=2, ts=29, TP: [cluster_name=ISPN] 09:58:43,215 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:35953. timeout=10000 (MILLISECONDS) 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35953. Timeout=10000 (MILLISECONDS) 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35953} 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35953}. Current=null 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35953}) => true 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35953}. WAITING => ACQUIRED 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35953} successfully acquired the lock. 09:58:43,220 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@73e97b26] 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:35953. timeout=10000 (MILLISECONDS) 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35953. Timeout=10000 (MILLISECONDS) 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35953} 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3cc4f0ff){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:43,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,220 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,225 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:43,225 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=87, conn_id=2, ts=29, TP: [cluster_name=ISPN] 09:58:43,227 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #87, conn-id=2, ts=29) 09:58:43,227 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,228 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:43,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:43,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88625] on Test-NodeA-7051 09:58:43,233 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #51, conn_id=0) 09:58:43,238 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88625, rsp_expected=true, UNICAST3: DATA, seqno=51, TP: [cluster_name=ISPN] 09:58:43,238 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (203 bytes (1015.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,238 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (206 bytes) 09:58:43,238 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=129 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88625, rsp_expected=true, UNICAST3: DATA, seqno=51, TP: [cluster_name=ISPN] 09:58:43,241 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #51, conn_id=0) 09:58:43,241 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#51 09:58:43,242 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88625 09:58:43,242 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:43,242 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:43,242 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,242 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,246 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:43,249 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21a1572] 09:58:43,249 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:43,250 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:43,251 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:43,255 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:43,256 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:43,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:43,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:43,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(13870efc){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:43,264 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,264 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,266 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(13870efc){key=key-to-change1, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:43,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:43,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:43,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:43,270 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:43,271 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=new-value} in container 09:58:43,272 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,276 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,276 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88625 to Test-NodeB-10318 09:58:43,279 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #50, conn_id=1) 09:58:43,279 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88625, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,280 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,280 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:43,280 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35953 09:58:43,280 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88625, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,280 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #50, conn_id=1) 09:58:43,287 TRACE (Timer-2,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:43,287 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:43,287 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,288 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:43,289 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:43,291 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#50 09:58:43,292 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,292 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:43,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3cc4f0ff){key=key-to-change1, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:43,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:43,298 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:43,301 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:43,305 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:43,305 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=new-value} in container 09:58:43,305 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, key=key-to-change1, value=new-value, oldValue=null, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:58:43,306 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@15d550f2[Not completed] to remote execution at node Test-NodeA-7051 09:58:43,306 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@2acbcedf] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,306 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@2acbcedf], mode=SYNCHRONOUS, timeout=15000 09:58:43,309 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@2acbcedf] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:43,310 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88638] on Test-NodeA-7051 09:58:43,310 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #52, conn_id=0) 09:58:43,310 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88638, rsp_expected=true, UNICAST3: DATA, seqno=52, TP: [cluster_name=ISPN] 09:58:43,311 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (373 bytes (1865.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,311 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (376 bytes) 09:58:43,312 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=299 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88638, rsp_expected=true, UNICAST3: DATA, seqno=52, TP: [cluster_name=ISPN] 09:58:43,312 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #52, conn_id=0) 09:58:43,313 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#52 09:58:43,314 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88638 09:58:43,314 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@188954c2] [sender=Test-NodeB-10318] 09:58:43,315 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:43,320 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,323 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@188954c2] 09:58:43,324 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_CREATED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=new-value, oldValue=null, transaction=null, retryCommand=false, origin=Test-NodeB-10318}], notifying cluster listener with id 62596a7d-4380-4aa7-8741-a6ffa97d3275 09:58:43,324 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@188954c2] 09:58:43,324 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88638 to Test-NodeB-10318 09:58:43,324 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #51, conn_id=1) 09:58:43,324 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88638, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,324 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,324 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:43,324 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88638, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,324 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #51, conn_id=1) 09:58:43,324 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#51 09:58:43,324 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,324 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@2acbcedf] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:43,324 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,324 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:35953 09:58:43,324 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35953. 09:58:43,325 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35953}. ACQUIRED => RELEASED 09:58:43,325 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35953}? true 09:58:43,325 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35953} 09:58:43,325 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35953}, null) => true 09:58:43,325 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:43,325 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,325 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88616 to Test-NodeA-7051 09:58:43,329 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #53, conn_id=0) 09:58:43,330 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88616, rsp_expected=true, UNICAST3: DATA, seqno=53, TP: [cluster_name=ISPN] 09:58:43,330 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:35953 09:58:43,330 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,330 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:43,331 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88616, rsp_expected=true, UNICAST3: DATA, seqno=53, TP: [cluster_name=ISPN] 09:58:43,332 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #53, conn_id=0) 09:58:43,341 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#53 09:58:43,343 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,344 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:43,345 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,347 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_released * 999999999 (available = 999999999, total = 999999999) 09:58:43,347 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_retrieve_entry_released * 1 (available = 999999998, total = 999999999) 09:58:43,349 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:43,349 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70514 09:58:43,350 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70514 excluding keys [] 09:58:43,350 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,350 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:43,350 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:43,350 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:43,350 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88651] on Test-NodeB-10318 09:58:43,350 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #52, conn_id=1) 09:58:43,350 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88651, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,351 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,351 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:43,351 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88651, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,351 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #52, conn_id=1) 09:58:43,353 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#52 09:58:43,353 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88651 09:58:43,361 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:43,361 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:43,361 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:43,361 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,363 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70514 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:43,363 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@1e8ff1ac] 09:58:43,363 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:43,363 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70514 09:58:43,364 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70514 09:58:43,364 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70514 09:58:43,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:43,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70514 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:43,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70514 09:58:43,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:43,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:43,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88655] on Test-NodeA-7051 09:58:43,366 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #54, conn_id=0) 09:58:43,366 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88655, rsp_expected=true, UNICAST3: DATA, seqno=54, TP: [cluster_name=ISPN] 09:58:43,366 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (253 bytes (1265.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,366 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (256 bytes) 09:58:43,366 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=179 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88655, rsp_expected=true, UNICAST3: DATA, seqno=54, TP: [cluster_name=ISPN] 09:58:43,366 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #54, conn_id=0) 09:58:43,366 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#54 09:58:43,366 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88655 09:58:43,366 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:43,366 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:43,366 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:43,367 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70514 with [] suspected segments. 09:58:43,367 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:43,367 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 3 09:58:43,367 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:43,367 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88655 to Test-NodeB-10318 09:58:43,367 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #53, conn_id=1) 09:58:43,367 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88655, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,367 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,367 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:43,367 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88655, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,367 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #53, conn_id=1) 09:58:43,367 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#53 09:58:43,367 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:43,367 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:43,367 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:43,367 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88651 to Test-NodeA-7051 09:58:43,367 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #55, conn_id=0) 09:58:43,367 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88651, rsp_expected=true, UNICAST3: DATA, seqno=55, TP: [cluster_name=ISPN] 09:58:43,367 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,367 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:43,367 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88651, rsp_expected=true, UNICAST3: DATA, seqno=55, TP: [cluster_name=ISPN] 09:58:43,367 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #55, conn_id=0) 09:58:43,367 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#55 09:58:43,367 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:43,367 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:43,367 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70514 excluding keys [] 09:58:43,372 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,373 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:43,373 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:43,373 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:43,373 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88657] on Test-NodeC-52778 09:58:43,377 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #88, conn_id=2) 09:58:43,377 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88657, rsp_expected=true, UNICAST3: DATA, seqno=88, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,380 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,380 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:43,381 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88657, rsp_expected=true, UNICAST3: DATA, seqno=88, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,382 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #88, conn_id=2) 09:58:43,387 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#88 09:58:43,387 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88657 09:58:43,392 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:43,392 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:43,392 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,392 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:43,392 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70514 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:43,395 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7cfc38d2] 09:58:43,396 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:43,396 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70514 09:58:43,396 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70514 09:58:43,396 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70514 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70514 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70514 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88664] on Test-NodeA-7051 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #91, conn_id=0) 09:58:43,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88664, rsp_expected=true, UNICAST3: DATA, seqno=91, TP: [cluster_name=ISPN] 09:58:43,397 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,397 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:43,397 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88664, rsp_expected=true, UNICAST3: DATA, seqno=91, TP: [cluster_name=ISPN] 09:58:43,398 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #91, conn_id=0) 09:58:43,398 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#91 09:58:43,398 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88664 09:58:43,398 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:43,399 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:43,399 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:43,399 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,400 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70514 with [] suspected segments. 09:58:43,401 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:43,403 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:43,406 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70514 as completed! 09:58:43,409 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:43,415 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88664 to Test-NodeC-52778 09:58:43,417 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #89, conn_id=2) 09:58:43,419 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88664, rsp_expected=true, UNICAST3: DATA, seqno=89, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,419 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,419 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:43,421 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88664, rsp_expected=true, UNICAST3: DATA, seqno=89, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,422 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #89, conn_id=2) 09:58:43,422 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#89 09:58:43,422 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:43,424 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:43,424 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:43,425 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88657 to Test-NodeA-7051 09:58:43,425 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #92, conn_id=0) 09:58:43,425 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88657, rsp_expected=true, UNICAST3: DATA, seqno=92, TP: [cluster_name=ISPN] 09:58:43,425 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,426 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:43,426 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88657, rsp_expected=true, UNICAST3: DATA, seqno=92, TP: [cluster_name=ISPN] 09:58:43,426 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #92, conn_id=0) 09:58:43,426 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#92 09:58:43,426 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:43,426 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:43,427 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:43,428 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-70514 09:58:43,428 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:43,428 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:43,428 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70514 09:58:43,429 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70514 being completed: true 09:58:43,429 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70514 09:58:43,429 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,430 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:43,432 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:43,438 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:43,441 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:43,441 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:43,450 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:43,450 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:43,460 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:43,477 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:43,480 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:43,480 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:43,480 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:43,480 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:43,492 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #53) 09:58:43,492 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=53, conn_id=1, ts=29, TP: [cluster_name=ISPN] 09:58:43,492 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,492 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:43,492 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=53, conn_id=1, ts=29, TP: [cluster_name=ISPN] 09:58:43,492 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #53, conn-id=1, ts=29) 09:58:43,480 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:43,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:43,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:43,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:43,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:43,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=new-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:43,498 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:43,498 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:43,498 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 62596a7d-4380-4aa7-8741-a6ffa97d3275 initial state for cache completed 09:58:43,498 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:43,502 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@5ea20e00[Not completed] to self 09:58:43,503 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5cf42202[Not completed] to remote execution at node Test-NodeB-10318 09:58:43,506 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3d98e8ca] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,506 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3d98e8ca], mode=SYNCHRONOUS, timeout=15000 09:58:43,506 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3d98e8ca] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:43,516 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88680] on Test-NodeB-10318 09:58:43,516 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #54, conn_id=1) 09:58:43,516 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88680, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,516 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,516 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:43,516 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@7a540980[Not completed] to remote execution at node Test-NodeC-52778 09:58:43,517 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3d98e8ca] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,517 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3d98e8ca], mode=SYNCHRONOUS, timeout=15000 09:58:43,517 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3d98e8ca] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:43,517 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88681] on Test-NodeC-52778 09:58:43,517 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #90, conn_id=2) 09:58:43,517 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88681, rsp_expected=true, UNICAST3: DATA, seqno=90, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,517 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,521 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88680, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,528 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #54, conn_id=1) 09:58:43,528 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#54 09:58:43,528 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88680 09:58:43,528 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@46593888] [sender=Test-NodeA-7051] 09:58:43,528 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:43,528 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,528 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@46593888] 09:58:43,522 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:43,535 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 62596a7d-4380-4aa7-8741-a6ffa97d3275 09:58:43,537 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@46593888] 09:58:43,537 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88680 to Test-NodeA-7051 09:58:43,537 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #56, conn_id=0) 09:58:43,537 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88680, rsp_expected=true, UNICAST3: DATA, seqno=56, TP: [cluster_name=ISPN] 09:58:43,537 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,538 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:43,534 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88681, rsp_expected=true, UNICAST3: DATA, seqno=90, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,538 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #90, conn_id=2) 09:58:43,539 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#90 09:58:43,539 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88681 09:58:43,539 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7aa84ad7] [sender=Test-NodeA-7051] 09:58:43,539 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:43,539 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7aa84ad7] 09:58:43,539 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 62596a7d-4380-4aa7-8741-a6ffa97d3275 09:58:43,539 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7aa84ad7] 09:58:43,539 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88681 to Test-NodeA-7051 09:58:43,539 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #93, conn_id=0) 09:58:43,539 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88681, rsp_expected=true, UNICAST3: DATA, seqno=93, TP: [cluster_name=ISPN] 09:58:43,539 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,540 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:43,541 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88681, rsp_expected=true, UNICAST3: DATA, seqno=93, TP: [cluster_name=ISPN] 09:58:43,541 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #93, conn_id=0) 09:58:43,542 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#93 09:58:43,542 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,542 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3d98e8ca] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:43,538 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88680, rsp_expected=true, UNICAST3: DATA, seqno=56, TP: [cluster_name=ISPN] 09:58:43,543 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #56, conn_id=0) 09:58:43,543 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#56 09:58:43,543 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,543 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3d98e8ca] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:43,543 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:43,543 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:43,543 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganButNotIteratedValueYetNonOwnerClustered 09:58:43,559 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:43,559 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:43,559 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:43,559 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:43,559 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:43,559 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:43,559 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:43,559 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:43,559 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:43,559 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:43,559 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:43,559 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:43,559 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:43,559 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:43,560 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganButNotIteratedValueYetOwnerClustered 09:58:43,560 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6273fd4b] 09:58:43,560 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:43,560 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:43,560 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:43,560 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:43,560 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,560 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,560 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:43,560 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,560 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:43,560 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:43,560 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88687] on Test-NodeB-10318 09:58:43,560 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #55, conn_id=1) 09:58:43,560 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88687, rsp_expected=true, UNICAST3: DATA, seqno=55, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,560 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,560 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:43,539 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,562 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88687, rsp_expected=true, UNICAST3: DATA, seqno=55, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,562 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #55, conn_id=1) 09:58:43,562 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#55 09:58:43,562 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88687 09:58:43,562 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:43,562 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:43,562 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35993. timeout=10000 (MILLISECONDS) 09:58:43,562 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35993. Timeout=10000 (MILLISECONDS) 09:58:43,700 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35993} 09:58:43,700 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35993}. Current=null 09:58:43,700 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:35993}) => true 09:58:43,700 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35993}. WAITING => ACQUIRED 09:58:43,700 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35993} successfully acquired the lock. 09:58:43,700 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:43,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@69bfda4d] 09:58:43,710 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:43,714 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:43,718 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #56) 09:58:43,718 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=56, ts=34, TP: [cluster_name=ISPN] 09:58:43,719 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #93) 09:58:43,719 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=93, ts=35, TP: [cluster_name=ISPN] 09:58:43,714 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:35993. timeout=10000 (MILLISECONDS) 09:58:43,719 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:43,723 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:43,723 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:43,724 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=93, ts=35, TP: [cluster_name=ISPN] 09:58:43,725 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #93, conn-id=0, ts=35) 09:58:43,728 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=56, ts=34, TP: [cluster_name=ISPN] 09:58:43,728 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #56, conn-id=0, ts=34) 09:58:43,720 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #90) 09:58:43,732 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=90, conn_id=2, ts=30, TP: [cluster_name=ISPN] 09:58:43,733 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,733 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:43,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:35993. Timeout=10000 (MILLISECONDS) 09:58:43,735 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=90, conn_id=2, ts=30, TP: [cluster_name=ISPN] 09:58:43,735 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #90, conn-id=2, ts=30) 09:58:43,733 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:35993} 09:58:43,750 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:43,755 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:43,769 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:43,783 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:43,783 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:43,783 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(36e30d08){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:43,783 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,783 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,783 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,784 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:43,784 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:43,784 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88700] on Test-NodeC-52778 09:58:43,784 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #23, conn_id=1) 09:58:43,784 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88700, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,784 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,784 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:43,784 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88700, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,784 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #23, conn_id=1) 09:58:43,784 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#23 09:58:43,784 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88700 09:58:43,784 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:43,814 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:43,814 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,814 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,814 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@56ba1c49] 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4ebed36d){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:43,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4ebed36d){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88700 to Test-NodeB-10318 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #23, conn_id=1) 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88700, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:35993 09:58:43,821 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:43,821 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:43,821 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88700, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 09:58:43,826 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #23, conn_id=1) 09:58:43,828 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#23 09:58:43,828 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,828 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:43,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(36e30d08){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:43,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:43,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:43,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:43,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:43,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:43,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35993 09:58:43,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:35993. 09:58:43,865 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35993}. ACQUIRED => RELEASED 09:58:43,868 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35993}? true 09:58:43,871 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35993} 09:58:43,872 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:35993}, null) => true 09:58:43,872 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:43,876 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,876 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88687 to Test-NodeA-7051 09:58:43,876 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #57, conn_id=0) 09:58:43,876 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88687, rsp_expected=true, UNICAST3: DATA, seqno=57, TP: [cluster_name=ISPN] 09:58:43,876 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:35993 09:58:43,877 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,877 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:43,880 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88687, rsp_expected=true, UNICAST3: DATA, seqno=57, TP: [cluster_name=ISPN] 09:58:43,880 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #57, conn_id=0) 09:58:43,880 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#57 09:58:43,880 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,880 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:43,881 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,881 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21f29e30] 09:58:43,881 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:43,881 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:43,881 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:43,881 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:43,881 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,881 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,881 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:43,881 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,881 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:43,881 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:43,881 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88710] on Test-NodeC-52778 09:58:43,881 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #91, conn_id=2) 09:58:43,881 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88710, rsp_expected=true, UNICAST3: DATA, seqno=91, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,881 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,881 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:43,885 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88710, rsp_expected=true, UNICAST3: DATA, seqno=91, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,885 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #91, conn_id=2) 09:58:43,885 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#91 09:58:43,886 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88710 09:58:43,886 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:43,887 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:43,887 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36011. timeout=10000 (MILLISECONDS) 09:58:43,887 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36011. Timeout=10000 (MILLISECONDS) 09:58:43,891 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36011} 09:58:43,902 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36011}. Current=null 09:58:43,905 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36011}) => true 09:58:43,907 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36011}. WAITING => ACQUIRED 09:58:43,907 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36011} successfully acquired the lock. 09:58:43,908 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,908 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:43,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@8fe35c9] 09:58:43,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:43,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:43,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36011. timeout=10000 (MILLISECONDS) 09:58:43,911 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36011. Timeout=10000 (MILLISECONDS) 09:58:43,912 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36011} 09:58:43,915 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:43,922 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:43,934 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:43,935 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:43,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:43,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(48c626e6){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:43,944 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,951 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,952 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:43,953 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:43,955 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88722] on Test-NodeA-7051 09:58:43,955 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #94, conn_id=0) 09:58:43,955 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88722, rsp_expected=true, UNICAST3: DATA, seqno=94, TP: [cluster_name=ISPN] 09:58:43,955 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,955 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:43,962 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88722, rsp_expected=true, UNICAST3: DATA, seqno=94, TP: [cluster_name=ISPN] 09:58:43,962 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #94, conn_id=0) 09:58:43,962 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#94 09:58:43,963 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88722 09:58:43,969 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:43,969 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:43,969 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@30cbeee9] 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1b90f6e2){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1b90f6e2){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88722 to Test-NodeC-52778 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #92, conn_id=2) 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88722, rsp_expected=true, UNICAST3: DATA, seqno=92, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,969 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36011 09:58:43,969 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:43,969 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:43,971 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88722, rsp_expected=true, UNICAST3: DATA, seqno=92, conn_id=2, TP: [cluster_name=ISPN] 09:58:43,971 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #92, conn_id=2) 09:58:43,971 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#92 09:58:43,971 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,971 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:43,971 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(48c626e6){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36011 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36011. 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36011}. ACQUIRED => RELEASED 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36011}? true 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36011} 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36011}, null) => true 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88710 to Test-NodeA-7051 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #95, conn_id=0) 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88710, rsp_expected=true, UNICAST3: DATA, seqno=95, TP: [cluster_name=ISPN] 09:58:43,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36011 09:58:43,974 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:43,974 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:43,975 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88710, rsp_expected=true, UNICAST3: DATA, seqno=95, TP: [cluster_name=ISPN] 09:58:43,975 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #95, conn_id=0) 09:58:43,975 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#95 09:58:43,975 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:43,975 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:43,980 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:43,982 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@581ef2e4] 09:58:43,983 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:43,983 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:43,984 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:43,985 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:43,986 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:43,986 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:43,992 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #55) 09:58:43,992 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=55, conn_id=1, ts=30, TP: [cluster_name=ISPN] 09:58:43,992 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #23) 09:58:43,992 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=23, conn_id=1, ts=31, TP: [cluster_name=ISPN] 09:58:43,993 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:43,993 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:43,993 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=23, conn_id=1, ts=31, TP: [cluster_name=ISPN] 09:58:43,993 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #23, conn-id=1, ts=31) 09:58:43,986 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:43,997 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:43,993 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:43,997 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:43,999 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:43,999 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=55, conn_id=1, ts=30, TP: [cluster_name=ISPN] 09:58:44,000 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #55, conn-id=1, ts=30) 09:58:43,999 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88738] on Test-NodeC-52778 09:58:44,029 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #93, conn_id=2) 09:58:44,029 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88738, rsp_expected=true, UNICAST3: DATA, seqno=93, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,029 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,029 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88738, rsp_expected=true, UNICAST3: DATA, seqno=93, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #93, conn_id=2) 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#93 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88738 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36023. timeout=10000 (MILLISECONDS) 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36023. Timeout=10000 (MILLISECONDS) 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36023} 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36023}. Current=null 09:58:44,042 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36023}) => true 09:58:44,062 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36023}. WAITING => ACQUIRED 09:58:44,063 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36023} successfully acquired the lock. 09:58:44,063 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,066 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,067 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@22556a4c] 09:58:44,070 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:44,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36023. timeout=10000 (MILLISECONDS) 09:58:44,092 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36023. Timeout=10000 (MILLISECONDS) 09:58:44,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36023} 09:58:44,172 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:44,219 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #57) 09:58:44,219 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=57, ts=36, TP: [cluster_name=ISPN] 09:58:44,219 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #95) 09:58:44,219 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,219 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=95, ts=37, TP: [cluster_name=ISPN] 09:58:44,201 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(492e7903){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88770] on Test-NodeB-10318 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #24, conn_id=1) 09:58:44,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88770, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,223 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,227 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:44,231 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=57, ts=36, TP: [cluster_name=ISPN] 09:58:44,231 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #57, conn-id=0, ts=36) 09:58:44,228 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,223 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:44,239 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88770, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,239 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #24, conn_id=1) 09:58:44,239 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#24 09:58:44,239 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88770 09:58:44,239 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:44,239 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,240 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7792f777] 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(c9c4eab){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(c9c4eab){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88770 to Test-NodeC-52778 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #24, conn_id=1) 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88770, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36023 09:58:44,240 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,240 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:44,242 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88770, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,242 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #24, conn_id=1) 09:58:44,242 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#24 09:58:44,242 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,242 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(492e7903){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36023 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36023. 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36023}. ACQUIRED => RELEASED 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36023}? true 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36023} 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36023}, null) => true 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88738 to Test-NodeA-7051 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #96, conn_id=0) 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88738, rsp_expected=true, UNICAST3: DATA, seqno=96, TP: [cluster_name=ISPN] 09:58:44,243 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36023 09:58:44,243 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,243 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:44,243 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88738, rsp_expected=true, UNICAST3: DATA, seqno=96, TP: [cluster_name=ISPN] 09:58:44,243 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #96, conn_id=0) 09:58:44,243 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#96 09:58:44,243 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,243 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:44,243 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,244 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3adb74ec] 09:58:44,244 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:44,244 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:44,244 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:44,244 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:44,244 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,244 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,244 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:44,244 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,244 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,244 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:44,244 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88772] on Test-NodeC-52778 09:58:44,244 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #94, conn_id=2) 09:58:44,244 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88772, rsp_expected=true, UNICAST3: DATA, seqno=94, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,233 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:44,259 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,259 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:44,233 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #23) 09:58:44,259 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88772, rsp_expected=true, UNICAST3: DATA, seqno=94, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,259 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #94, conn_id=2) 09:58:44,260 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=23, conn_id=1, ts=31, TP: [cluster_name=ISPN] 09:58:44,260 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#94 09:58:44,272 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88772 09:58:44,259 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=95, ts=37, TP: [cluster_name=ISPN] 09:58:44,275 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #95, conn-id=0, ts=37) 09:58:44,276 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:44,276 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,276 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,282 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:44,282 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=23, conn_id=1, ts=31, TP: [cluster_name=ISPN] 09:58:44,282 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #23, conn-id=1, ts=31) 09:58:44,276 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #94) 09:58:44,283 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=94, conn_id=2, ts=32, TP: [cluster_name=ISPN] 09:58:44,283 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,284 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:44,281 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36047. timeout=10000 (MILLISECONDS) 09:58:44,284 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36047. Timeout=10000 (MILLISECONDS) 09:58:44,284 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36047} 09:58:44,284 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36047}. Current=null 09:58:44,284 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36047}) => true 09:58:44,284 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36047}. WAITING => ACQUIRED 09:58:44,284 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36047} successfully acquired the lock. 09:58:44,284 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,286 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=94, conn_id=2, ts=32, TP: [cluster_name=ISPN] 09:58:44,286 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #94, conn-id=2, ts=32) 09:58:44,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,297 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7607a58e] 09:58:44,297 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36047. timeout=10000 (MILLISECONDS) 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36047. Timeout=10000 (MILLISECONDS) 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36047} 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:44,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(496c0379){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:44,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88778] on Test-NodeB-10318 09:58:44,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #25, conn_id=1) 09:58:44,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88778, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,317 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,329 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:44,329 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88778, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,329 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #25, conn_id=1) 09:58:44,332 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#25 09:58:44,332 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88778 09:58:44,332 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:44,352 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@77cf2218] 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1702accd){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1702accd){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88778 to Test-NodeC-52778 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #25, conn_id=1) 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88778, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,353 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36047 09:58:44,353 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,353 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:44,353 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88778, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,353 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #25, conn_id=1) 09:58:44,353 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#25 09:58:44,353 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,354 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(496c0379){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36047 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36047. 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36047}. ACQUIRED => RELEASED 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36047}? true 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36047} 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36047}, null) => true 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88772 to Test-NodeA-7051 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #97, conn_id=0) 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88772, rsp_expected=true, UNICAST3: DATA, seqno=97, TP: [cluster_name=ISPN] 09:58:44,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36047 09:58:44,354 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,354 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:44,353 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,356 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88772, rsp_expected=true, UNICAST3: DATA, seqno=97, TP: [cluster_name=ISPN] 09:58:44,371 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #97, conn_id=0) 09:58:44,371 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#97 09:58:44,371 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,371 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:44,371 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,372 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@785a3916] 09:58:44,372 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:44,372 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:44,372 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:44,372 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:44,372 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,372 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,372 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:44,372 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,372 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,372 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:44,372 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88785] on Test-NodeC-52778 09:58:44,372 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #95, conn_id=2) 09:58:44,372 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88785, rsp_expected=true, UNICAST3: DATA, seqno=95, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,372 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,372 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:44,373 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88785, rsp_expected=true, UNICAST3: DATA, seqno=95, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #95, conn_id=2) 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#95 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88785 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36056. timeout=10000 (MILLISECONDS) 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36056. Timeout=10000 (MILLISECONDS) 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36056} 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36056}. Current=null 09:58:44,383 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36056}) => true 09:58:44,389 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36056}. WAITING => ACQUIRED 09:58:44,389 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36056} successfully acquired the lock. 09:58:44,390 TRACE (Timer-2,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:44,390 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:44,390 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,390 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:44,391 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:44,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,397 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,397 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeC-52778: mine: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:44,397 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:44,398 TRACE (INT-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:58:44,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,399 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@25055bae] 09:58:44,399 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,399 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:44,399 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36056. timeout=10000 (MILLISECONDS) 09:58:44,399 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36056. Timeout=10000 (MILLISECONDS) 09:58:44,399 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36056} 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2a1413b3){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88788] on Test-NodeA-7051 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #98, conn_id=0) 09:58:44,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88788, rsp_expected=true, UNICAST3: DATA, seqno=98, TP: [cluster_name=ISPN] 09:58:44,400 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,401 TRACE (Timer-3,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stability msg Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:44,401 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:44,398 TRACE (INT-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 6 from Test-NodeA-7051 09:58:44,408 TRACE (INT-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 0 from Test-NodeB-10318 09:58:44,409 TRACE (INT-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 0 from Test-NodeC-52778 09:58:44,401 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:58:44,422 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (120 bytes (600.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:44,400 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:44,423 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (123 bytes) 09:58:44,423 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (123 bytes) 09:58:44,424 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88788, rsp_expected=true, UNICAST3: DATA, seqno=98, TP: [cluster_name=ISPN] 09:58:44,424 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #98, conn_id=0) 09:58:44,424 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#98 09:58:44,424 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88788 09:58:44,424 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:44,424 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,424 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@287c6277] 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(c4263ad){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(c4263ad){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:44,422 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:44,424 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:44,425 TRACE (INT-1,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: received stability msg from Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:44,425 TRACE (INT-1,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:44,425 TRACE (INT-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:58:44,425 TRACE (INT-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 6 from Test-NodeA-7051 09:58:44,425 TRACE (INT-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 0 from Test-NodeB-10318 09:58:44,425 TRACE (INT-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 0 from Test-NodeC-52778 09:58:44,425 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:44,425 TRACE (INT-1,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: received stability msg from Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:44,425 TRACE (INT-1,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:44,425 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:58:44,425 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 6 from Test-NodeA-7051 09:58:44,425 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 0 from Test-NodeB-10318 09:58:44,425 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 0 from Test-NodeC-52778 09:58:44,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,431 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,431 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88788 to Test-NodeC-52778 09:58:44,431 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #96, conn_id=2) 09:58:44,431 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88788, rsp_expected=true, UNICAST3: DATA, seqno=96, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,431 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36056 09:58:44,432 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,432 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:44,438 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88788, rsp_expected=true, UNICAST3: DATA, seqno=96, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,440 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #96, conn_id=2) 09:58:44,440 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#96 09:58:44,447 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,447 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:44,447 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2a1413b3){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,447 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:44,447 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,447 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:44,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:44,469 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,470 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36056 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36056. 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36056}. ACQUIRED => RELEASED 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36056}? true 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36056} 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36056}, null) => true 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88785 to Test-NodeA-7051 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #99, conn_id=0) 09:58:44,471 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88785, rsp_expected=true, UNICAST3: DATA, seqno=99, TP: [cluster_name=ISPN] 09:58:44,474 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36056 09:58:44,492 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #25) 09:58:44,492 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=25, conn_id=1, ts=32, TP: [cluster_name=ISPN] 09:58:44,493 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,493 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:44,474 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,494 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:44,493 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=25, conn_id=1, ts=32, TP: [cluster_name=ISPN] 09:58:44,494 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #25, conn-id=1, ts=32) 09:58:44,494 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88785, rsp_expected=true, UNICAST3: DATA, seqno=99, TP: [cluster_name=ISPN] 09:58:44,494 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #99, conn_id=0) 09:58:44,494 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#99 09:58:44,494 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,494 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:44,494 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,494 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2469e28a] 09:58:44,494 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:44,494 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:44,494 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:36065. timeout=10000 (MILLISECONDS) 09:58:44,495 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36065. Timeout=10000 (MILLISECONDS) 09:58:44,495 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36065} 09:58:44,495 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36065}. Current=null 09:58:44,495 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36065}) => true 09:58:44,495 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36065}. WAITING => ACQUIRED 09:58:44,495 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36065} successfully acquired the lock. 09:58:44,495 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:44,495 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:44,495 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,495 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,495 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:44,495 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(9df4227){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,495 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,495 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,495 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:44,495 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,499 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,499 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:44,500 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88798] on Test-NodeB-10318 09:58:44,501 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #56, conn_id=1) 09:58:44,501 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88798, rsp_expected=true, UNICAST3: DATA, seqno=56, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,501 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,537 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:44,568 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88798, rsp_expected=true, UNICAST3: DATA, seqno=56, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,592 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #56, conn_id=1) 09:58:44,592 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#56 09:58:44,607 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88798 09:58:44,612 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:44,612 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,612 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@77cbd815] 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(194c2951){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(194c2951){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88798 to Test-NodeA-7051 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #58, conn_id=0) 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88798, rsp_expected=true, UNICAST3: DATA, seqno=58, TP: [cluster_name=ISPN] 09:58:44,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36065 09:58:44,613 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,613 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:44,613 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88798, rsp_expected=true, UNICAST3: DATA, seqno=58, TP: [cluster_name=ISPN] 09:58:44,614 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #58, conn_id=0) 09:58:44,614 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#58 09:58:44,614 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,614 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:44,614 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(9df4227){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,614 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:44,614 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,614 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,614 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:44,614 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:44,614 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,614 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:36065 09:58:44,614 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36065. 09:58:44,614 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36065}. ACQUIRED => RELEASED 09:58:44,614 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36065}? true 09:58:44,614 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36065} 09:58:44,614 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36065}, null) => true 09:58:44,614 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:44,614 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@28251cd0] 09:58:44,614 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:44,614 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:44,614 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:44,614 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:44,614 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,614 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,614 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:44,614 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,614 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,614 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:44,614 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88809] on Test-NodeC-52778 09:58:44,614 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #97, conn_id=2) 09:58:44,614 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88809, rsp_expected=true, UNICAST3: DATA, seqno=97, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,615 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,615 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:44,615 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88809, rsp_expected=true, UNICAST3: DATA, seqno=97, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #97, conn_id=2) 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#97 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88809 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36080. timeout=10000 (MILLISECONDS) 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36080. Timeout=10000 (MILLISECONDS) 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36080} 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36080}. Current=null 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36080}) => true 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36080}. WAITING => ACQUIRED 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36080} successfully acquired the lock. 09:58:44,616 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@72562a8a] 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36080. timeout=10000 (MILLISECONDS) 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36080. Timeout=10000 (MILLISECONDS) 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36080} 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4dcc5f6d){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:44,616 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88810] on Test-NodeA-7051 09:58:44,617 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #100, conn_id=0) 09:58:44,617 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88810, rsp_expected=true, UNICAST3: DATA, seqno=100, TP: [cluster_name=ISPN] 09:58:44,617 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,617 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:44,618 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88810, rsp_expected=true, UNICAST3: DATA, seqno=100, TP: [cluster_name=ISPN] 09:58:44,618 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #100, conn_id=0) 09:58:44,618 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#100 09:58:44,618 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88810 09:58:44,618 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:44,618 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,618 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6391686a] 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7faab51c){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7faab51c){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88810 to Test-NodeC-52778 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #98, conn_id=2) 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88810, rsp_expected=true, UNICAST3: DATA, seqno=98, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,618 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36080 09:58:44,618 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,618 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:44,618 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88810, rsp_expected=true, UNICAST3: DATA, seqno=98, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,618 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #98, conn_id=2) 09:58:44,618 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#98 09:58:44,618 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,619 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4dcc5f6d){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36080 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36080. 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36080}. ACQUIRED => RELEASED 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36080}? true 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36080} 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36080}, null) => true 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88809 to Test-NodeA-7051 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #101, conn_id=0) 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88809, rsp_expected=true, UNICAST3: DATA, seqno=101, TP: [cluster_name=ISPN] 09:58:44,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36080 09:58:44,619 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,620 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:44,620 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88809, rsp_expected=true, UNICAST3: DATA, seqno=101, TP: [cluster_name=ISPN] 09:58:44,620 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #101, conn_id=0) 09:58:44,620 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#101 09:58:44,620 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,620 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:44,620 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,620 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@37f53662] 09:58:44,620 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:44,620 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:44,620 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:44,620 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:44,620 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,620 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,620 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:44,620 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,620 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,620 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:44,620 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88811] on Test-NodeC-52778 09:58:44,620 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #99, conn_id=2) 09:58:44,620 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88811, rsp_expected=true, UNICAST3: DATA, seqno=99, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,620 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,620 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88811, rsp_expected=true, UNICAST3: DATA, seqno=99, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #99, conn_id=2) 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#99 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88811 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36082. timeout=10000 (MILLISECONDS) 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36082. Timeout=10000 (MILLISECONDS) 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36082} 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36082}. Current=null 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36082}) => true 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36082}. WAITING => ACQUIRED 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36082} successfully acquired the lock. 09:58:44,621 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3fbf9b24] 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36082. timeout=10000 (MILLISECONDS) 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36082. Timeout=10000 (MILLISECONDS) 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36082} 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2a9248bc){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88812] on Test-NodeA-7051 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #102, conn_id=0) 09:58:44,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88812, rsp_expected=true, UNICAST3: DATA, seqno=102, TP: [cluster_name=ISPN] 09:58:44,621 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,621 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:44,622 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88812, rsp_expected=true, UNICAST3: DATA, seqno=102, TP: [cluster_name=ISPN] 09:58:44,622 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #102, conn_id=0) 09:58:44,622 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#102 09:58:44,622 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88812 09:58:44,622 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:44,622 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,622 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@340e1f44] 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2bce4d63){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2bce4d63){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88812 to Test-NodeC-52778 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #100, conn_id=2) 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88812, rsp_expected=true, UNICAST3: DATA, seqno=100, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,622 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36082 09:58:44,622 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,622 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:44,622 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88812, rsp_expected=true, UNICAST3: DATA, seqno=100, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,622 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #100, conn_id=2) 09:58:44,622 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#100 09:58:44,622 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,622 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:44,623 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2a9248bc){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,623 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:44,623 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,623 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,623 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:44,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:44,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36082 09:58:44,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36082. 09:58:44,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36082}. ACQUIRED => RELEASED 09:58:44,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36082}? true 09:58:44,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36082} 09:58:44,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36082}, null) => true 09:58:44,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:44,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88811 to Test-NodeA-7051 09:58:44,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #103, conn_id=0) 09:58:44,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88811, rsp_expected=true, UNICAST3: DATA, seqno=103, TP: [cluster_name=ISPN] 09:58:44,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36082 09:58:44,647 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,647 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:44,647 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88811, rsp_expected=true, UNICAST3: DATA, seqno=103, TP: [cluster_name=ISPN] 09:58:44,647 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #103, conn_id=0) 09:58:44,647 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#103 09:58:44,647 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,647 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:44,647 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,647 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@46723905] 09:58:44,647 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:44,647 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:44,647 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:44,647 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:44,647 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,647 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,647 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:44,647 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,647 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,647 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:44,647 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88816] on Test-NodeB-10318 09:58:44,647 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #57, conn_id=1) 09:58:44,647 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88816, rsp_expected=true, UNICAST3: DATA, seqno=57, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,647 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,648 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:44,651 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88816, rsp_expected=true, UNICAST3: DATA, seqno=57, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,651 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #57, conn_id=1) 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#57 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88816 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36086. timeout=10000 (MILLISECONDS) 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36086. Timeout=10000 (MILLISECONDS) 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36086} 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36086}. Current=null 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36086}) => true 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36086}. WAITING => ACQUIRED 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36086} successfully acquired the lock. 09:58:44,652 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@171d1782] 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36086. timeout=10000 (MILLISECONDS) 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36086. Timeout=10000 (MILLISECONDS) 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36086} 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(15fba568){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:44,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88820] on Test-NodeC-52778 09:58:44,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #26, conn_id=1) 09:58:44,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88820, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,664 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,665 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:44,665 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88820, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,665 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #26, conn_id=1) 09:58:44,665 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#26 09:58:44,665 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88820 09:58:44,665 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:44,665 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,665 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,682 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:44,682 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@39bf0edd] 09:58:44,682 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:44,682 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:44,682 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:44,682 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:44,682 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:44,665 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:44,682 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:44,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:44,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5bcf64af){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:44,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5bcf64af){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:44,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:44,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:44,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88820 to Test-NodeB-10318 09:58:44,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #26, conn_id=1) 09:58:44,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88820, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36086 09:58:44,686 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,686 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:44,722 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #58) 09:58:44,759 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=58, ts=38, TP: [cluster_name=ISPN] 09:58:44,759 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,759 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:44,759 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #103) 09:58:44,917 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=103, ts=39, TP: [cluster_name=ISPN] 09:58:44,917 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,918 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:44,919 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=103, ts=39, TP: [cluster_name=ISPN] 09:58:44,935 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #103, conn-id=0, ts=39) 09:58:44,915 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #26) 09:58:44,955 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=26, conn_id=1, ts=33, TP: [cluster_name=ISPN] 09:58:44,956 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:44,956 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:44,956 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=26, conn_id=1, ts=33, TP: [cluster_name=ISPN] 09:58:44,956 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #26, conn-id=1, ts=33) 09:58:44,773 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=58, ts=38, TP: [cluster_name=ISPN] 09:58:44,957 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #58, conn-id=0, ts=38) 09:58:44,766 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88820, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 09:58:44,960 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #26, conn_id=1) 09:58:44,961 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#26 09:58:44,961 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,961 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:44,955 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #100) 09:58:44,964 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=100, conn_id=2, ts=34, TP: [cluster_name=ISPN] 09:58:44,964 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,964 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:44,965 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=100, conn_id=2, ts=34, TP: [cluster_name=ISPN] 09:58:44,965 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #100, conn-id=2, ts=34) 09:58:44,961 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(15fba568){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36086 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36086. 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36086}. ACQUIRED => RELEASED 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36086}? true 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36086} 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36086}, null) => true 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88816 to Test-NodeA-7051 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #59, conn_id=0) 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88816, rsp_expected=true, UNICAST3: DATA, seqno=59, TP: [cluster_name=ISPN] 09:58:44,984 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36086 09:58:44,984 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:44,984 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:44,984 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88816, rsp_expected=true, UNICAST3: DATA, seqno=59, TP: [cluster_name=ISPN] 09:58:44,985 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #59, conn_id=0) 09:58:44,985 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#59 09:58:44,985 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:44,985 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:44,985 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:44,985 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@42284d45] 09:58:44,985 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:44,985 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:44,985 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:44,985 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:44,985 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:44,985 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:44,985 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:44,985 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:44,985 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:44,985 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:44,985 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88835] on Test-NodeC-52778 09:58:44,985 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #101, conn_id=2) 09:58:44,985 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88835, rsp_expected=true, UNICAST3: DATA, seqno=101, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,985 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:44,985 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:44,990 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88835, rsp_expected=true, UNICAST3: DATA, seqno=101, conn_id=2, TP: [cluster_name=ISPN] 09:58:44,990 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #101, conn_id=2) 09:58:44,990 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#101 09:58:44,990 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88835 09:58:44,990 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:44,990 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:44,993 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #57) 09:58:44,993 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=57, conn_id=1, ts=33, TP: [cluster_name=ISPN] 09:58:44,993 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #26) 09:58:44,993 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=26, conn_id=1, ts=34, TP: [cluster_name=ISPN] 09:58:44,993 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:44,994 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:44,994 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:44,995 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=26, conn_id=1, ts=34, TP: [cluster_name=ISPN] 09:58:44,998 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=57, conn_id=1, ts=33, TP: [cluster_name=ISPN] 09:58:44,998 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #57, conn-id=1, ts=33) 09:58:44,995 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #26, conn-id=1, ts=34) 09:58:44,990 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36092. timeout=10000 (MILLISECONDS) 09:58:45,031 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36092. Timeout=10000 (MILLISECONDS) 09:58:45,031 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36092} 09:58:45,031 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36092}. Current=null 09:58:45,031 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36092}) => true 09:58:45,031 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36092}. WAITING => ACQUIRED 09:58:45,031 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36092} successfully acquired the lock. 09:58:45,032 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7ad01eca] 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36092. timeout=10000 (MILLISECONDS) 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36092. Timeout=10000 (MILLISECONDS) 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36092} 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(555d6568){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88845] on Test-NodeA-7051 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #104, conn_id=0) 09:58:45,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88845, rsp_expected=true, UNICAST3: DATA, seqno=104, TP: [cluster_name=ISPN] 09:58:45,034 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,034 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:45,034 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88845, rsp_expected=true, UNICAST3: DATA, seqno=104, TP: [cluster_name=ISPN] 09:58:45,034 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #104, conn_id=0) 09:58:45,034 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#104 09:58:45,034 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88845 09:58:45,034 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:45,034 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,034 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4374b248] 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(69dcfd6f){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(69dcfd6f){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,034 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88845 to Test-NodeC-52778 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #102, conn_id=2) 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88845, rsp_expected=true, UNICAST3: DATA, seqno=102, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,035 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36092 09:58:45,035 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,035 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:45,040 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88845, rsp_expected=true, UNICAST3: DATA, seqno=102, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,040 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #102, conn_id=2) 09:58:45,040 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#102 09:58:45,040 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,040 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:45,045 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(555d6568){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36092 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36092. 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36092}. ACQUIRED => RELEASED 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36092}? true 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36092} 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36092}, null) => true 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88835 to Test-NodeA-7051 09:58:45,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #105, conn_id=0) 09:58:45,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88835, rsp_expected=true, UNICAST3: DATA, seqno=105, TP: [cluster_name=ISPN] 09:58:45,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36092 09:58:45,103 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,103 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,103 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88835, rsp_expected=true, UNICAST3: DATA, seqno=105, TP: [cluster_name=ISPN] 09:58:45,103 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #105, conn_id=0) 09:58:45,103 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#105 09:58:45,103 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,103 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,106 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,108 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:45,108 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:45,109 DEBUG (testng-Test:[]) [Test] Found key key-to-change0 with primary owner Test-NodeA-7051, segment 51 09:58:45,133 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_invoked * 1 09:58:45,133 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:45,134 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id b7523e83-839e-4fb6-8217-829f5a3ab5ce 09:58:45,134 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@44d8af86[Not completed] to remote execution at node Test-NodeB-10318 09:58:45,134 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f010951] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,134 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f010951], mode=SYNCHRONOUS, timeout=15000 09:58:45,134 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f010951] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:45,134 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88856] on Test-NodeB-10318 09:58:45,134 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #58, conn_id=1) 09:58:45,134 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88856, rsp_expected=true, UNICAST3: DATA, seqno=58, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,134 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@1cf32793[Not completed] to remote execution at node Test-NodeC-52778 09:58:45,134 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f010951] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,134 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f010951], mode=SYNCHRONOUS, timeout=15000 09:58:45,134 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f010951] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:45,136 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,136 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:45,136 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88857] on Test-NodeC-52778 09:58:45,136 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #103, conn_id=2) 09:58:45,136 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88857, rsp_expected=true, UNICAST3: DATA, seqno=103, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,136 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,136 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:45,137 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88857, rsp_expected=true, UNICAST3: DATA, seqno=103, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,137 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #103, conn_id=2) 09:58:45,137 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#103 09:58:45,137 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88857 09:58:45,138 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@74a29f76] [sender=Test-NodeA-7051] 09:58:45,138 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:45,138 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,138 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@74a29f76] 09:58:45,138 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id b7523e83-839e-4fb6-8217-829f5a3ab5ce 09:58:45,138 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@74a29f76] 09:58:45,138 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88857 to Test-NodeA-7051 09:58:45,138 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #106, conn_id=0) 09:58:45,138 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88857, rsp_expected=true, UNICAST3: DATA, seqno=106, TP: [cluster_name=ISPN] 09:58:45,138 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,138 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,139 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88857, rsp_expected=true, UNICAST3: DATA, seqno=106, TP: [cluster_name=ISPN] 09:58:45,139 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #106, conn_id=0) 09:58:45,139 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#106 09:58:45,139 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,139 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f010951] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,136 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88856, rsp_expected=true, UNICAST3: DATA, seqno=58, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,162 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #58, conn_id=1) 09:58:45,168 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#58 09:58:45,168 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88856 09:58:45,168 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6e90abaa] [sender=Test-NodeA-7051] 09:58:45,168 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:45,168 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,172 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6e90abaa] 09:58:45,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id b7523e83-839e-4fb6-8217-829f5a3ab5ce 09:58:45,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6e90abaa] 09:58:45,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88856 to Test-NodeA-7051 09:58:45,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #60, conn_id=0) 09:58:45,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88856, rsp_expected=true, UNICAST3: DATA, seqno=60, TP: [cluster_name=ISPN] 09:58:45,173 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,173 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,176 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88856, rsp_expected=true, UNICAST3: DATA, seqno=60, TP: [cluster_name=ISPN] 09:58:45,176 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #60, conn_id=0) 09:58:45,177 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#60 09:58:45,177 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,177 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3f010951] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:45,177 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener b7523e83-839e-4fb6-8217-829f5a3ab5ce requests initial state for cache 09:58:45,177 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@311eab9d] 09:58:45,177 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:45,178 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_invoked * 1 (available = 1, total = 1) 09:58:45,178 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_released * 1 09:58:45,178 TRACE (testng-Test:[]) [CheckPoint] Received event pre_retrieve_entry_invoked * 1 (available = 0, total = 1) 09:58:45,179 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@509ddc2] 09:58:45,179 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:45,179 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:58:45,179 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:36111. timeout=10000 (MILLISECONDS) 09:58:45,179 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36111. Timeout=10000 (MILLISECONDS) 09:58:45,179 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36111} 09:58:45,179 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36111}. Current=null 09:58:45,179 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36111}) => true 09:58:45,179 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36111}. WAITING => ACQUIRED 09:58:45,179 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36111} successfully acquired the lock. 09:58:45,179 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:45,179 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:45,179 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,179 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,179 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:45,179 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1d3c1225){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,179 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,179 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,179 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:45,179 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,179 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,179 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:45,179 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88861] on Test-NodeB-10318 09:58:45,179 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #59, conn_id=1) 09:58:45,180 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88861, rsp_expected=true, UNICAST3: DATA, seqno=59, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,180 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (203 bytes (1015.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,180 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (206 bytes) 09:58:45,180 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=129 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88861, rsp_expected=true, UNICAST3: DATA, seqno=59, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,180 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #59, conn_id=1) 09:58:45,180 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#59 09:58:45,180 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88861 09:58:45,180 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:45,180 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,180 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,180 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,180 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,180 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7e917be0] 09:58:45,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:58:45,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:45,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:45,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(b8b0968){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(b8b0968){key=key-to-change0, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=new-value} in container 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88861 to Test-NodeA-7051 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #61, conn_id=0) 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88861, rsp_expected=true, UNICAST3: DATA, seqno=61, TP: [cluster_name=ISPN] 09:58:45,230 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36111 09:58:45,230 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,230 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,231 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88861, rsp_expected=true, UNICAST3: DATA, seqno=61, TP: [cluster_name=ISPN] 09:58:45,268 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #61, conn_id=0) 09:58:45,268 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#61 09:58:45,269 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,269 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change0, value=new-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:45,269 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1d3c1225){key=key-to-change0, value=new-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,269 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:45,269 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,269 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=new-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,269 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=new-value 09:58:45,269 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=new-value} in container 09:58:45,269 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,269 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:36111 09:58:45,269 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36111. 09:58:45,269 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36111}. ACQUIRED => RELEASED 09:58:45,269 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36111}? true 09:58:45,269 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36111} 09:58:45,269 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36111}, null) => true 09:58:45,269 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:45,269 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_released * 999999999 (available = 999999999, total = 999999999) 09:58:45,269 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_retrieve_entry_released * 1 (available = 999999998, total = 999999999) 09:58:45,273 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:45,274 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70515 09:58:45,275 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70515 excluding keys [] 09:58:45,275 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,275 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:45,276 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:45,276 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:45,277 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88869] on Test-NodeB-10318 09:58:45,277 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #60, conn_id=1) 09:58:45,277 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88869, rsp_expected=true, UNICAST3: DATA, seqno=60, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,277 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,277 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:45,277 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88869, rsp_expected=true, UNICAST3: DATA, seqno=60, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,277 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #60, conn_id=1) 09:58:45,277 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#60 09:58:45,277 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88869 09:58:45,277 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:45,277 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,277 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,277 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:45,277 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70515 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:45,277 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7717c883] 09:58:45,277 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70515 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70515 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70515 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70515 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70515 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:45,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:45,279 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88870] on Test-NodeA-7051 09:58:45,279 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #62, conn_id=0) 09:58:45,279 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88870, rsp_expected=true, UNICAST3: DATA, seqno=62, TP: [cluster_name=ISPN] 09:58:45,279 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (224 bytes (1120.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,279 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (227 bytes) 09:58:45,279 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=150 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88870, rsp_expected=true, UNICAST3: DATA, seqno=62, TP: [cluster_name=ISPN] 09:58:45,279 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #62, conn_id=0) 09:58:45,279 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#62 09:58:45,279 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88870 09:58:45,279 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:45,279 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:45,279 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,279 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:45,279 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70515 with [] suspected segments. 09:58:45,279 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:45,279 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:45,279 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:45,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88870 to Test-NodeB-10318 09:58:45,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #61, conn_id=1) 09:58:45,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88870, rsp_expected=true, UNICAST3: DATA, seqno=61, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,307 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,307 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:45,307 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88870, rsp_expected=true, UNICAST3: DATA, seqno=61, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,307 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #61, conn_id=1) 09:58:45,307 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#61 09:58:45,307 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:45,307 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:45,307 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:45,307 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88869 to Test-NodeA-7051 09:58:45,307 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #63, conn_id=0) 09:58:45,307 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88869, rsp_expected=true, UNICAST3: DATA, seqno=63, TP: [cluster_name=ISPN] 09:58:45,307 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,307 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:45,308 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88869, rsp_expected=true, UNICAST3: DATA, seqno=63, TP: [cluster_name=ISPN] 09:58:45,308 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #63, conn_id=0) 09:58:45,308 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#63 09:58:45,308 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:45,308 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:45,308 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70515 excluding keys [] 09:58:45,308 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,308 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:45,308 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:45,308 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:45,308 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88875] on Test-NodeC-52778 09:58:45,308 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #104, conn_id=2) 09:58:45,308 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88875, rsp_expected=true, UNICAST3: DATA, seqno=104, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,308 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,308 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:45,309 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88875, rsp_expected=true, UNICAST3: DATA, seqno=104, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,309 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #104, conn_id=2) 09:58:45,309 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#104 09:58:45,311 TRACE (Timer-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:45,343 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:45,309 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88875 09:58:45,343 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:45,343 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,345 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,345 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:45,345 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70515 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:45,343 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:58:45,345 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:45,345 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeA-7051: mine: Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:45,345 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@717401b] 09:58:45,348 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:45,348 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70515 09:58:45,348 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70515 09:58:45,348 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70515 09:58:45,348 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:45,349 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70515 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:45,356 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70515 09:58:45,356 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,356 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:45,356 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:45,356 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88882] on Test-NodeA-7051 09:58:45,356 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #107, conn_id=0) 09:58:45,356 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88882, rsp_expected=true, UNICAST3: DATA, seqno=107, TP: [cluster_name=ISPN] 09:58:45,356 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,356 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:45,356 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88882, rsp_expected=true, UNICAST3: DATA, seqno=107, TP: [cluster_name=ISPN] 09:58:45,356 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #107, conn_id=0) 09:58:45,356 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#107 09:58:45,371 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:58:45,371 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:45,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:45,356 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88882 09:58:45,387 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:45,387 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:45,387 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70515 with [] suspected segments. 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70515 as completed! 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88882 to Test-NodeC-52778 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #105, conn_id=2) 09:58:45,387 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88882, rsp_expected=true, UNICAST3: DATA, seqno=105, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,388 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,388 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:45,388 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88882, rsp_expected=true, UNICAST3: DATA, seqno=105, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,388 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #105, conn_id=2) 09:58:45,388 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#105 09:58:45,388 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:45,388 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:45,388 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:45,388 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88875 to Test-NodeA-7051 09:58:45,388 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #108, conn_id=0) 09:58:45,388 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88875, rsp_expected=true, UNICAST3: DATA, seqno=108, TP: [cluster_name=ISPN] 09:58:45,392 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,393 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:45,396 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88875, rsp_expected=true, UNICAST3: DATA, seqno=108, TP: [cluster_name=ISPN] 09:58:45,396 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #108, conn_id=0) 09:58:45,396 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#108 09:58:45,396 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:45,396 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,396 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:45,397 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 2 for id Test-NodeA-70515 09:58:45,397 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:45,397 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 2 09:58:45,397 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70515 09:58:45,397 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70515 being completed: true 09:58:45,397 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70515 09:58:45,397 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:45,397 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:45,398 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,398 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,398 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,398 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,398 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,398 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:45,398 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,398 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change0, value=new-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:45,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:45,398 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener b7523e83-839e-4fb6-8217-829f5a3ab5ce initial state for cache completed 09:58:45,398 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:45,409 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@4d2f53bf[Not completed] to self 09:58:45,409 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@6d695a72[Not completed] to remote execution at node Test-NodeB-10318 09:58:45,409 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4d81705a] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,409 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4d81705a], mode=SYNCHRONOUS, timeout=15000 09:58:45,409 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4d81705a] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:45,409 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88888] on Test-NodeB-10318 09:58:45,409 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #62, conn_id=1) 09:58:45,409 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88888, rsp_expected=true, UNICAST3: DATA, seqno=62, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,410 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@788d854f[Not completed] to remote execution at node Test-NodeC-52778 09:58:45,410 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4d81705a] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,410 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4d81705a], mode=SYNCHRONOUS, timeout=15000 09:58:45,410 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4d81705a] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:45,410 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88889] on Test-NodeC-52778 09:58:45,410 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #106, conn_id=2) 09:58:45,410 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88889, rsp_expected=true, UNICAST3: DATA, seqno=106, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,410 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (424 bytes (2120.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:45,410 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:45,410 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:45,410 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88889, rsp_expected=true, UNICAST3: DATA, seqno=106, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,410 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #106, conn_id=2) 09:58:45,410 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#106 09:58:45,410 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88889 09:58:45,410 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2b70beb7] [sender=Test-NodeA-7051] 09:58:45,410 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:45,410 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,410 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88888, rsp_expected=true, UNICAST3: DATA, seqno=62, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,410 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #62, conn_id=1) 09:58:45,410 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#62 09:58:45,411 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88888 09:58:45,411 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@16ae05c] [sender=Test-NodeA-7051] 09:58:45,411 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:45,411 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,411 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@16ae05c] 09:58:45,411 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : b7523e83-839e-4fb6-8217-829f5a3ab5ce 09:58:45,411 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@16ae05c] 09:58:45,411 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88888 to Test-NodeA-7051 09:58:45,411 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #64, conn_id=0) 09:58:45,411 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88888, rsp_expected=true, UNICAST3: DATA, seqno=64, TP: [cluster_name=ISPN] 09:58:45,419 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #63) 09:58:45,419 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=63, ts=40, TP: [cluster_name=ISPN] 09:58:45,419 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #108) 09:58:45,419 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=108, ts=41, TP: [cluster_name=ISPN] 09:58:45,419 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:45,419 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:45,419 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:45,421 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,421 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,422 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2b70beb7] 09:58:45,424 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88888, rsp_expected=true, UNICAST3: DATA, seqno=64, TP: [cluster_name=ISPN] 09:58:45,441 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=108, ts=41, TP: [cluster_name=ISPN] 09:58:45,441 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #108, conn-id=0, ts=41) 09:58:45,441 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=63, ts=40, TP: [cluster_name=ISPN] 09:58:45,457 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #63, conn-id=0, ts=40) 09:58:45,465 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #106) 09:58:45,465 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=106, conn_id=2, ts=35, TP: [cluster_name=ISPN] 09:58:45,466 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,466 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:45,466 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=106, conn_id=2, ts=35, TP: [cluster_name=ISPN] 09:58:45,466 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #106, conn-id=2, ts=35) 09:58:45,424 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #64, conn_id=0) 09:58:45,466 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#64 09:58:45,466 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,466 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4d81705a] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:45,422 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : b7523e83-839e-4fb6-8217-829f5a3ab5ce 09:58:45,494 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #62) 09:58:45,494 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=62, conn_id=1, ts=35, TP: [cluster_name=ISPN] 09:58:45,494 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,495 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:45,495 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2b70beb7] 09:58:45,495 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88889 to Test-NodeA-7051 09:58:45,495 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #109, conn_id=0) 09:58:45,495 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88889, rsp_expected=true, UNICAST3: DATA, seqno=109, TP: [cluster_name=ISPN] 09:58:45,496 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,496 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,496 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88889, rsp_expected=true, UNICAST3: DATA, seqno=109, TP: [cluster_name=ISPN] 09:58:45,505 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #109, conn_id=0) 09:58:45,505 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#109 09:58:45,505 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,505 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4d81705a] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,510 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:45,510 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:45,510 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testCreateAfterIterationBeganButNotIteratedValueYetOwnerClustered 09:58:45,510 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:45,510 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:45,511 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:45,511 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:45,511 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:45,511 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:45,511 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:45,511 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:45,511 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:45,511 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:45,511 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:45,511 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:45,511 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:45,511 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:45,511 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndCompletedSegmentValueNonOwnerClustered 09:58:45,511 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@8837c91] 09:58:45,511 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:45,511 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:45,511 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:45,511 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:45,512 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,512 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,512 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:45,512 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,512 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,512 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:45,512 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88899] on Test-NodeB-10318 09:58:45,512 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #63, conn_id=1) 09:58:45,512 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88899, rsp_expected=true, UNICAST3: DATA, seqno=63, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,512 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,512 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:45,512 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88899, rsp_expected=true, UNICAST3: DATA, seqno=63, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,512 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #63, conn_id=1) 09:58:45,512 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#63 09:58:45,512 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88899 09:58:45,512 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:36138. timeout=10000 (MILLISECONDS) 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36138. Timeout=10000 (MILLISECONDS) 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36138} 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36138}. Current=null 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36138}) => true 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36138}. WAITING => ACQUIRED 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36138} successfully acquired the lock. 09:58:45,513 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@16e7b378] 09:58:45,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:45,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:36138. timeout=10000 (MILLISECONDS) 09:58:45,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36138. Timeout=10000 (MILLISECONDS) 09:58:45,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36138} 09:58:45,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:45,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:45,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:45,519 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(242fa43c){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:45,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=88900] on Test-NodeC-52778 09:58:45,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #27, conn_id=1) 09:58:45,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88900, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,520 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,520 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:45,521 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88900, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,522 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #27, conn_id=1) 09:58:45,495 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=62, conn_id=1, ts=35, TP: [cluster_name=ISPN] 09:58:45,522 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #62, conn-id=1, ts=35) 09:58:45,522 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#27 09:58:45,530 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88900 09:58:45,545 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:45,545 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,550 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5feb1563] 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(24bfa082){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(24bfa082){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,550 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88900 to Test-NodeB-10318 09:58:45,551 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #27, conn_id=1) 09:58:45,551 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88900, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,551 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36138 09:58:45,552 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,552 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:45,553 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88900, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,553 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #27, conn_id=1) 09:58:45,553 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#27 09:58:45,553 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,553 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(242fa43c){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:36138 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36138. 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36138}. ACQUIRED => RELEASED 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36138}? true 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36138} 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36138}, null) => true 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88899 to Test-NodeA-7051 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #65, conn_id=0) 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88899, rsp_expected=true, UNICAST3: DATA, seqno=65, TP: [cluster_name=ISPN] 09:58:45,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:36138 09:58:45,556 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,556 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,556 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88899, rsp_expected=true, UNICAST3: DATA, seqno=65, TP: [cluster_name=ISPN] 09:58:45,556 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #65, conn_id=0) 09:58:45,556 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#65 09:58:45,556 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,565 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:45,570 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,574 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6a8cb9b9] 09:58:45,574 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:45,574 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:45,574 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:45,574 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:45,574 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,574 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,574 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:45,574 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,574 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,574 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:45,574 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88907] on Test-NodeC-52778 09:58:45,574 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #107, conn_id=2) 09:58:45,574 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88907, rsp_expected=true, UNICAST3: DATA, seqno=107, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,575 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,575 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:45,575 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88907, rsp_expected=true, UNICAST3: DATA, seqno=107, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,575 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #107, conn_id=2) 09:58:45,587 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#107 09:58:45,587 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88907 09:58:45,587 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:45,587 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,587 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36150. timeout=10000 (MILLISECONDS) 09:58:45,587 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36150. Timeout=10000 (MILLISECONDS) 09:58:45,587 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36150} 09:58:45,604 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36150}. Current=null 09:58:45,606 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36150}) => true 09:58:45,606 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36150}. WAITING => ACQUIRED 09:58:45,606 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36150} successfully acquired the lock. 09:58:45,606 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@29cde95f] 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36150. timeout=10000 (MILLISECONDS) 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36150. Timeout=10000 (MILLISECONDS) 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36150} 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(11a2bd79){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88912] on Test-NodeA-7051 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #110, conn_id=0) 09:58:45,606 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88912, rsp_expected=true, UNICAST3: DATA, seqno=110, TP: [cluster_name=ISPN] 09:58:45,606 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,606 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:45,607 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88912, rsp_expected=true, UNICAST3: DATA, seqno=110, TP: [cluster_name=ISPN] 09:58:45,607 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #110, conn_id=0) 09:58:45,607 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#110 09:58:45,607 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88912 09:58:45,607 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:45,607 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,607 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1290c48c] 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1c296434){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1c296434){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88912 to Test-NodeC-52778 09:58:45,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #108, conn_id=2) 09:58:45,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88912, rsp_expected=true, UNICAST3: DATA, seqno=108, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36150 09:58:45,608 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,608 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:45,608 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88912, rsp_expected=true, UNICAST3: DATA, seqno=108, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,608 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #108, conn_id=2) 09:58:45,608 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#108 09:58:45,608 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,608 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:45,610 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(11a2bd79){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,612 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:45,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:45,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:45,618 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36150 09:58:45,623 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36150. 09:58:45,628 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36150}. ACQUIRED => RELEASED 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36150}? true 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36150} 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36150}, null) => true 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88907 to Test-NodeA-7051 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #111, conn_id=0) 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88907, rsp_expected=true, UNICAST3: DATA, seqno=111, TP: [cluster_name=ISPN] 09:58:45,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36150 09:58:45,638 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,639 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,649 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88907, rsp_expected=true, UNICAST3: DATA, seqno=111, TP: [cluster_name=ISPN] 09:58:45,649 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #111, conn_id=0) 09:58:45,649 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#111 09:58:45,649 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,649 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,649 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,649 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1ea1e4f7] 09:58:45,649 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:45,649 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:45,649 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:45,649 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:45,649 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,649 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,649 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:45,649 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,650 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,650 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:45,650 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88923] on Test-NodeC-52778 09:58:45,650 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #109, conn_id=2) 09:58:45,650 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88923, rsp_expected=true, UNICAST3: DATA, seqno=109, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,650 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,650 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88923, rsp_expected=true, UNICAST3: DATA, seqno=109, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #109, conn_id=2) 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#109 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88923 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36159. timeout=10000 (MILLISECONDS) 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36159. Timeout=10000 (MILLISECONDS) 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36159} 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36159}. Current=null 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36159}) => true 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36159}. WAITING => ACQUIRED 09:58:45,650 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36159} successfully acquired the lock. 09:58:45,651 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@446f9a79] 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36159. timeout=10000 (MILLISECONDS) 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36159. Timeout=10000 (MILLISECONDS) 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36159} 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7eb09beb){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88925] on Test-NodeB-10318 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #28, conn_id=1) 09:58:45,651 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88925, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,651 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,651 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:45,651 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88925, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,655 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #28, conn_id=1) 09:58:45,655 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#28 09:58:45,655 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88925 09:58:45,655 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:45,655 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,655 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@756b745d] 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(567aa2d0){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(567aa2d0){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88925 to Test-NodeC-52778 09:58:45,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #28, conn_id=1) 09:58:45,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88925, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36159 09:58:45,665 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,665 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:45,665 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88925, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,665 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #28, conn_id=1) 09:58:45,665 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#28 09:58:45,666 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,666 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:45,666 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7eb09beb){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,667 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:45,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:45,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:45,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36159 09:58:45,669 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36159. 09:58:45,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36159}. ACQUIRED => RELEASED 09:58:45,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36159}? true 09:58:45,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36159} 09:58:45,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36159}, null) => true 09:58:45,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:45,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88923 to Test-NodeA-7051 09:58:45,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #112, conn_id=0) 09:58:45,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88923, rsp_expected=true, UNICAST3: DATA, seqno=112, TP: [cluster_name=ISPN] 09:58:45,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36159 09:58:45,681 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,681 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,681 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88923, rsp_expected=true, UNICAST3: DATA, seqno=112, TP: [cluster_name=ISPN] 09:58:45,681 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #112, conn_id=0) 09:58:45,684 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#112 09:58:45,684 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,684 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,685 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,685 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@72d89c5b] 09:58:45,695 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:45,695 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:45,695 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:45,695 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:45,695 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,695 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,695 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:45,695 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,695 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,695 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:45,695 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88933] on Test-NodeC-52778 09:58:45,695 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #110, conn_id=2) 09:58:45,695 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88933, rsp_expected=true, UNICAST3: DATA, seqno=110, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,695 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,695 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:45,695 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88933, rsp_expected=true, UNICAST3: DATA, seqno=110, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,695 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #110, conn_id=2) 09:58:45,704 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#110 09:58:45,704 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88933 09:58:45,704 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36163. timeout=10000 (MILLISECONDS) 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36163. Timeout=10000 (MILLISECONDS) 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36163} 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36163}. Current=null 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36163}) => true 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36163}. WAITING => ACQUIRED 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36163} successfully acquired the lock. 09:58:45,714 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@61dada6f] 09:58:45,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:45,724 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36163. timeout=10000 (MILLISECONDS) 09:58:45,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36163. Timeout=10000 (MILLISECONDS) 09:58:45,725 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36163} 09:58:45,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:45,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:45,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,744 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:45,746 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6e196150){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,746 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:45,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88940] on Test-NodeB-10318 09:58:45,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #29, conn_id=1) 09:58:45,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88940, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,762 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,763 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:45,776 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88940, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,776 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #29, conn_id=1) 09:58:45,776 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#29 09:58:45,776 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88940 09:58:45,776 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:45,776 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,776 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@168e1ce1] 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:45,780 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2ddecd17){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,780 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,780 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,791 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2ddecd17){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,792 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:45,792 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88940 to Test-NodeC-52778 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #29, conn_id=1) 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88940, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36163 09:58:45,797 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,797 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:45,799 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88940, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=1, TP: [cluster_name=ISPN] 09:58:45,800 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #29, conn_id=1) 09:58:45,800 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#29 09:58:45,800 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,800 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:45,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6e196150){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36163 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36163. 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36163}. ACQUIRED => RELEASED 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36163}? true 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36163} 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36163}, null) => true 09:58:45,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:45,817 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,817 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88933 to Test-NodeA-7051 09:58:45,817 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #113, conn_id=0) 09:58:45,817 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88933, rsp_expected=true, UNICAST3: DATA, seqno=113, TP: [cluster_name=ISPN] 09:58:45,817 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36163 09:58:45,817 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,817 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,820 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88933, rsp_expected=true, UNICAST3: DATA, seqno=113, TP: [cluster_name=ISPN] 09:58:45,821 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #113, conn_id=0) 09:58:45,821 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#113 09:58:45,830 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,830 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,838 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,849 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@51b89180] 09:58:45,849 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:45,855 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:45,856 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:45,864 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:45,864 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,867 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,868 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:45,868 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,868 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,868 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:45,868 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88955] on Test-NodeC-52778 09:58:45,868 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #111, conn_id=2) 09:58:45,868 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88955, rsp_expected=true, UNICAST3: DATA, seqno=111, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,868 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,868 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:45,868 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88955, rsp_expected=true, UNICAST3: DATA, seqno=111, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,871 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #111, conn_id=2) 09:58:45,871 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#111 09:58:45,871 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88955 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36182. timeout=10000 (MILLISECONDS) 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36182. Timeout=10000 (MILLISECONDS) 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36182} 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36182}. Current=null 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36182}) => true 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36182}. WAITING => ACQUIRED 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36182} successfully acquired the lock. 09:58:45,878 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4208fec8] 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36182. timeout=10000 (MILLISECONDS) 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36182. Timeout=10000 (MILLISECONDS) 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36182} 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(37e67f66){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,878 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:45,879 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:45,879 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:45,879 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88957] on Test-NodeA-7051 09:58:45,879 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #114, conn_id=0) 09:58:45,879 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88957, rsp_expected=true, UNICAST3: DATA, seqno=114, TP: [cluster_name=ISPN] 09:58:45,879 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,879 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:45,879 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88957, rsp_expected=true, UNICAST3: DATA, seqno=114, TP: [cluster_name=ISPN] 09:58:45,879 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #114, conn_id=0) 09:58:45,879 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#114 09:58:45,879 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88957 09:58:45,879 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:45,879 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:45,880 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,880 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:45,880 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@50d091dd] 09:58:45,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:45,880 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:45,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:45,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:45,886 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:45,886 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:45,886 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:45,886 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:45,886 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(22c7901d){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:45,889 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:45,919 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #65) 09:58:45,919 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=65, ts=42, TP: [cluster_name=ISPN] 09:58:45,919 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #114) 09:58:45,919 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:45,919 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=114, ts=43, TP: [cluster_name=ISPN] 09:58:45,909 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:45,919 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:45,922 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,922 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=65, ts=42, TP: [cluster_name=ISPN] 09:58:45,922 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:45,922 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(22c7901d){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:45,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,929 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #65, conn-id=0, ts=42) 09:58:45,931 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=114, ts=43, TP: [cluster_name=ISPN] 09:58:45,931 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #114, conn-id=0, ts=43) 09:58:45,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,932 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:45,933 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:45,933 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,934 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,934 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88957 to Test-NodeC-52778 09:58:45,934 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #112, conn_id=2) 09:58:45,934 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88957, rsp_expected=true, UNICAST3: DATA, seqno=112, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,936 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36182 09:58:45,936 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,936 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:45,939 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88957, rsp_expected=true, UNICAST3: DATA, seqno=112, conn_id=2, TP: [cluster_name=ISPN] 09:58:45,939 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #112, conn_id=2) 09:58:45,947 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#112 09:58:45,952 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,952 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:45,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(37e67f66){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:45,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:45,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:45,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:45,960 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:45,960 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:45,960 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36182 09:58:45,968 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36182. 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36182}. ACQUIRED => RELEASED 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36182}? true 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36182} 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36182}, null) => true 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88955 to Test-NodeA-7051 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #115, conn_id=0) 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88955, rsp_expected=true, UNICAST3: DATA, seqno=115, TP: [cluster_name=ISPN] 09:58:45,969 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36182 09:58:45,969 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #29) 09:58:45,969 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=29, conn_id=1, ts=36, TP: [cluster_name=ISPN] 09:58:45,969 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #112) 09:58:45,969 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=112, conn_id=2, ts=37, TP: [cluster_name=ISPN] 09:58:45,969 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,970 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:45,970 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:45,970 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:45,970 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:45,970 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=29, conn_id=1, ts=36, TP: [cluster_name=ISPN] 09:58:45,970 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=112, conn_id=2, ts=37, TP: [cluster_name=ISPN] 09:58:45,983 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #29, conn-id=1, ts=36) 09:58:45,970 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88955, rsp_expected=true, UNICAST3: DATA, seqno=115, TP: [cluster_name=ISPN] 09:58:45,984 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #115, conn_id=0) 09:58:45,984 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#115 09:58:45,984 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:45,984 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:45,990 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:45,987 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #112, conn-id=2, ts=37) 09:58:45,996 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@447f4bc8] 09:58:45,996 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #63) 09:58:45,997 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=63, conn_id=1, ts=36, TP: [cluster_name=ISPN] 09:58:45,998 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #29) 09:58:45,998 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:45,997 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:45,998 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:45,998 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:36193. timeout=10000 (MILLISECONDS) 09:58:45,998 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36193. Timeout=10000 (MILLISECONDS) 09:58:45,998 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36193} 09:58:45,998 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:45,998 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=29, conn_id=1, ts=37, TP: [cluster_name=ISPN] 09:58:45,999 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:45,999 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:45,999 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=63, conn_id=1, ts=36, TP: [cluster_name=ISPN] 09:58:45,998 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36193}. Current=null 09:58:46,000 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #63, conn-id=1, ts=36) 09:58:46,000 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=29, conn_id=1, ts=37, TP: [cluster_name=ISPN] 09:58:46,001 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36193}) => true 09:58:46,001 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #29, conn-id=1, ts=37) 09:58:46,001 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36193}. WAITING => ACQUIRED 09:58:46,001 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36193} successfully acquired the lock. 09:58:46,002 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:46,002 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:46,004 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,020 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,020 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:46,020 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(30cec6a8){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,020 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,020 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,020 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:46,020 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,020 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,020 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:46,020 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88980] on Test-NodeB-10318 09:58:46,020 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #64, conn_id=1) 09:58:46,020 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88980, rsp_expected=true, UNICAST3: DATA, seqno=64, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,020 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,020 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:46,020 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88980, rsp_expected=true, UNICAST3: DATA, seqno=64, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,020 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #64, conn_id=1) 09:58:46,020 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#64 09:58:46,020 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88980 09:58:46,020 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:46,021 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,021 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,021 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,021 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,029 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3b98d6d] 09:58:46,029 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,031 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:46,031 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:46,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:46,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:46,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(d6c3e8){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,036 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,036 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(d6c3e8){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,036 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:46,036 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 88980 to Test-NodeA-7051 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #66, conn_id=0) 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88980, rsp_expected=true, UNICAST3: DATA, seqno=66, TP: [cluster_name=ISPN] 09:58:46,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36193 09:58:46,037 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,037 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:46,037 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88980, rsp_expected=true, UNICAST3: DATA, seqno=66, TP: [cluster_name=ISPN] 09:58:46,042 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #66, conn_id=0) 09:58:46,042 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#66 09:58:46,050 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,050 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:46,051 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(30cec6a8){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,051 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:46,051 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,051 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,051 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:46,051 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:46,051 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,051 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:36193 09:58:46,051 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36193. 09:58:46,051 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36193}. ACQUIRED => RELEASED 09:58:46,051 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36193}? true 09:58:46,051 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36193} 09:58:46,051 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36193}, null) => true 09:58:46,051 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:46,051 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5568fbff] 09:58:46,051 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:46,051 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:46,051 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:46,051 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:46,051 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,051 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,051 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:46,051 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,051 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,051 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:46,051 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88981] on Test-NodeC-52778 09:58:46,051 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #113, conn_id=2) 09:58:46,051 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88981, rsp_expected=true, UNICAST3: DATA, seqno=113, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,052 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,052 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:46,055 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88981, rsp_expected=true, UNICAST3: DATA, seqno=113, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #113, conn_id=2) 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#113 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88981 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36198. timeout=10000 (MILLISECONDS) 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36198. Timeout=10000 (MILLISECONDS) 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36198} 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36198}. Current=null 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36198}) => true 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36198}. WAITING => ACQUIRED 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36198} successfully acquired the lock. 09:58:46,056 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,056 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,056 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@43934d36] 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36198. timeout=10000 (MILLISECONDS) 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36198. Timeout=10000 (MILLISECONDS) 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36198} 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(782ccb91){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88982] on Test-NodeA-7051 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #116, conn_id=0) 09:58:46,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88982, rsp_expected=true, UNICAST3: DATA, seqno=116, TP: [cluster_name=ISPN] 09:58:46,074 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,075 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:46,079 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88982, rsp_expected=true, UNICAST3: DATA, seqno=116, TP: [cluster_name=ISPN] 09:58:46,165 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #116, conn_id=0) 09:58:46,165 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#116 09:58:46,165 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88982 09:58:46,165 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:46,165 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,165 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3667846d] 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(61384e51){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(61384e51){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88982 to Test-NodeC-52778 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #114, conn_id=2) 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88982, rsp_expected=true, UNICAST3: DATA, seqno=114, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,166 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36198 09:58:46,166 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,174 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:46,174 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88982, rsp_expected=true, UNICAST3: DATA, seqno=114, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,174 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #114, conn_id=2) 09:58:46,174 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#114 09:58:46,174 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,226 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(782ccb91){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36198 09:58:46,226 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36198. 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36198}. ACQUIRED => RELEASED 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36198}? true 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36198} 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36198}, null) => true 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88981 to Test-NodeA-7051 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #117, conn_id=0) 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88981, rsp_expected=true, UNICAST3: DATA, seqno=117, TP: [cluster_name=ISPN] 09:58:46,227 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36198 09:58:46,227 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,227 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:46,227 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88981, rsp_expected=true, UNICAST3: DATA, seqno=117, TP: [cluster_name=ISPN] 09:58:46,243 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #117, conn_id=0) 09:58:46,243 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#117 09:58:46,243 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,244 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:46,244 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,244 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5e8091cc] 09:58:46,244 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:46,244 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:46,244 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:46,244 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:46,244 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,244 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,244 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:46,244 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,244 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,244 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:46,244 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=88992] on Test-NodeC-52778 09:58:46,244 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #115, conn_id=2) 09:58:46,244 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88992, rsp_expected=true, UNICAST3: DATA, seqno=115, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,244 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,244 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:46,245 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88992, rsp_expected=true, UNICAST3: DATA, seqno=115, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,245 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #115, conn_id=2) 09:58:46,245 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#115 09:58:46,245 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88992 09:58:46,245 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:46,245 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,245 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36225. timeout=10000 (MILLISECONDS) 09:58:46,245 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36225. Timeout=10000 (MILLISECONDS) 09:58:46,261 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36225} 09:58:46,261 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36225}. Current=null 09:58:46,261 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36225}) => true 09:58:46,262 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36225}. WAITING => ACQUIRED 09:58:46,262 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36225} successfully acquired the lock. 09:58:46,262 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,262 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,262 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,262 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@14ae821c] 09:58:46,262 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36225. timeout=10000 (MILLISECONDS) 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36225. Timeout=10000 (MILLISECONDS) 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36225} 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7e0d7abb){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=88995] on Test-NodeA-7051 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #118, conn_id=0) 09:58:46,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88995, rsp_expected=true, UNICAST3: DATA, seqno=118, TP: [cluster_name=ISPN] 09:58:46,263 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,263 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:46,264 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=88995, rsp_expected=true, UNICAST3: DATA, seqno=118, TP: [cluster_name=ISPN] 09:58:46,264 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #118, conn_id=0) 09:58:46,264 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#118 09:58:46,264 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 88995 09:58:46,264 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:46,265 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,265 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,265 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,265 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,273 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@35b265d2] 09:58:46,273 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2beb4c01){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,274 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2beb4c01){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,275 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:46,275 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,275 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,275 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:46,275 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:46,275 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,275 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,275 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 88995 to Test-NodeC-52778 09:58:46,353 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #116, conn_id=2) 09:58:46,355 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88995, rsp_expected=true, UNICAST3: DATA, seqno=116, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,356 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,359 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:46,355 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36225 09:58:46,360 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88995, rsp_expected=true, UNICAST3: DATA, seqno=116, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,365 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #116, conn_id=2) 09:58:46,365 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#116 09:58:46,366 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,366 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:46,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7e0d7abb){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:46,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:46,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:46,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36225 09:58:46,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36225. 09:58:46,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36225}. ACQUIRED => RELEASED 09:58:46,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36225}? true 09:58:46,375 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36225} 09:58:46,375 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36225}, null) => true 09:58:46,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:46,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 88992 to Test-NodeA-7051 09:58:46,378 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #119, conn_id=0) 09:58:46,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88992, rsp_expected=true, UNICAST3: DATA, seqno=119, TP: [cluster_name=ISPN] 09:58:46,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36225 09:58:46,381 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,381 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:46,382 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=88992, rsp_expected=true, UNICAST3: DATA, seqno=119, TP: [cluster_name=ISPN] 09:58:46,383 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #119, conn_id=0) 09:58:46,383 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#119 09:58:46,383 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,383 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:46,383 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,384 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@ab47605] 09:58:46,394 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:46,397 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:46,397 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:46,397 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:46,399 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,400 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,402 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:46,402 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,404 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,405 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:46,413 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89004] on Test-NodeB-10318 09:58:46,414 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #65, conn_id=1) 09:58:46,416 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89004, rsp_expected=true, UNICAST3: DATA, seqno=65, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,416 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,417 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:46,419 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #66) 09:58:46,419 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=66, ts=44, TP: [cluster_name=ISPN] 09:58:46,419 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,419 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:46,420 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=66, ts=44, TP: [cluster_name=ISPN] 09:58:46,421 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #66, conn-id=0, ts=44) 09:58:46,419 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89004, rsp_expected=true, UNICAST3: DATA, seqno=65, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,422 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #65, conn_id=1) 09:58:46,419 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #119) 09:58:46,422 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=119, ts=45, TP: [cluster_name=ISPN] 09:58:46,422 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,422 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#65 09:58:46,422 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89004 09:58:46,423 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:46,422 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:46,423 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,424 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=119, ts=45, TP: [cluster_name=ISPN] 09:58:46,424 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #119, conn-id=0, ts=45) 09:58:46,427 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36230. timeout=10000 (MILLISECONDS) 09:58:46,428 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36230. Timeout=10000 (MILLISECONDS) 09:58:46,428 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36230} 09:58:46,428 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36230}. Current=null 09:58:46,430 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36230}) => true 09:58:46,430 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36230}. WAITING => ACQUIRED 09:58:46,430 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36230} successfully acquired the lock. 09:58:46,430 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,430 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,430 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,433 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6659be07] 09:58:46,433 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,434 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:46,435 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36230. timeout=10000 (MILLISECONDS) 09:58:46,435 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36230. Timeout=10000 (MILLISECONDS) 09:58:46,435 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36230} 09:58:46,435 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:46,446 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:46,450 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,451 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:46,453 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3db461ae){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,453 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,453 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,453 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,454 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,455 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:46,455 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89016] on Test-NodeC-52778 09:58:46,455 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #30, conn_id=1) 09:58:46,455 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89016, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,455 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,455 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:46,457 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89016, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,457 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #30, conn_id=1) 09:58:46,460 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#30 09:58:46,461 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89016 09:58:46,463 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:46,463 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,463 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4067767e] 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(14fcccc1){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(14fcccc1){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89016 to Test-NodeB-10318 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #30, conn_id=1) 09:58:46,463 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89016, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,465 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36230 09:58:46,465 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:46,467 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89016, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,468 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #30, conn_id=1) 09:58:46,468 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#30 09:58:46,468 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,469 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:46,470 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #30) 09:58:46,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3db461ae){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,478 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=30, conn_id=1, ts=38, TP: [cluster_name=ISPN] 09:58:46,481 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,481 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:46,481 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #116) 09:58:46,481 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=30, conn_id=1, ts=38, TP: [cluster_name=ISPN] 09:58:46,481 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #30, conn-id=1, ts=38) 09:58:46,481 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:46,483 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,483 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,483 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:46,483 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=116, conn_id=2, ts=39, TP: [cluster_name=ISPN] 09:58:46,484 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:46,484 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,484 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36230 09:58:46,486 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36230. 09:58:46,486 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36230}. ACQUIRED => RELEASED 09:58:46,484 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,486 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:46,486 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36230}? true 09:58:46,488 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36230} 09:58:46,489 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36230}, null) => true 09:58:46,489 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:46,488 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=116, conn_id=2, ts=39, TP: [cluster_name=ISPN] 09:58:46,489 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,499 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #65) 09:58:46,499 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=65, conn_id=1, ts=38, TP: [cluster_name=ISPN] 09:58:46,499 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #30) 09:58:46,499 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=30, conn_id=1, ts=39, TP: [cluster_name=ISPN] 09:58:46,499 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,499 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:46,499 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,499 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:46,499 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=30, conn_id=1, ts=39, TP: [cluster_name=ISPN] 09:58:46,499 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #30, conn-id=1, ts=39) 09:58:46,489 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89004 to Test-NodeA-7051 09:58:46,489 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #116, conn-id=2, ts=39) 09:58:46,508 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #67, conn_id=0) 09:58:46,512 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89004, rsp_expected=true, UNICAST3: DATA, seqno=67, TP: [cluster_name=ISPN] 09:58:46,512 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36230 09:58:46,513 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,513 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:46,505 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=65, conn_id=1, ts=38, TP: [cluster_name=ISPN] 09:58:46,513 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #65, conn-id=1, ts=38) 09:58:46,513 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89004, rsp_expected=true, UNICAST3: DATA, seqno=67, TP: [cluster_name=ISPN] 09:58:46,515 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #67, conn_id=0) 09:58:46,515 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#67 09:58:46,516 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,516 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:46,534 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,536 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@482bc4e0] 09:58:46,536 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:46,536 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:46,536 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:46,536 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:46,536 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,541 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,541 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:46,541 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,541 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,541 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:46,541 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89032] on Test-NodeC-52778 09:58:46,541 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #117, conn_id=2) 09:58:46,541 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89032, rsp_expected=true, UNICAST3: DATA, seqno=117, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,541 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,541 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:46,541 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89032, rsp_expected=true, UNICAST3: DATA, seqno=117, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #117, conn_id=2) 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#117 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89032 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36247. timeout=10000 (MILLISECONDS) 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36247. Timeout=10000 (MILLISECONDS) 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36247} 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36247}. Current=null 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36247}) => true 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36247}. WAITING => ACQUIRED 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36247} successfully acquired the lock. 09:58:46,545 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3ef8806d] 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36247. timeout=10000 (MILLISECONDS) 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36247. Timeout=10000 (MILLISECONDS) 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36247} 09:58:46,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:46,547 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:46,551 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,564 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,566 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:46,566 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(61f9fb32){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,572 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,573 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,575 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,596 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:46,596 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89042] on Test-NodeA-7051 09:58:46,596 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #120, conn_id=0) 09:58:46,596 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89042, rsp_expected=true, UNICAST3: DATA, seqno=120, TP: [cluster_name=ISPN] 09:58:46,597 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,597 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:46,598 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89042, rsp_expected=true, UNICAST3: DATA, seqno=120, TP: [cluster_name=ISPN] 09:58:46,598 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #120, conn_id=0) 09:58:46,598 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#120 09:58:46,598 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89042 09:58:46,598 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:46,598 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,601 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,601 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,601 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,602 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21a5f1fd] 09:58:46,602 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,603 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:46,604 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:46,604 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:46,605 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,605 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,605 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:46,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(24c695e){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(24c695e){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:46,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,607 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:46,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:46,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89042 to Test-NodeC-52778 09:58:46,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #118, conn_id=2) 09:58:46,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89042, rsp_expected=true, UNICAST3: DATA, seqno=118, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,608 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36247 09:58:46,608 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,611 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:46,611 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89042, rsp_expected=true, UNICAST3: DATA, seqno=118, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,611 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #118, conn_id=2) 09:58:46,611 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#118 09:58:46,611 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,611 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(61f9fb32){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36247 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36247. 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36247}. ACQUIRED => RELEASED 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36247}? true 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36247} 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36247}, null) => true 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89032 to Test-NodeA-7051 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #121, conn_id=0) 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89032, rsp_expected=true, UNICAST3: DATA, seqno=121, TP: [cluster_name=ISPN] 09:58:46,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36247 09:58:46,611 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,611 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:46,611 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89032, rsp_expected=true, UNICAST3: DATA, seqno=121, TP: [cluster_name=ISPN] 09:58:46,611 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #121, conn_id=0) 09:58:46,612 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#121 09:58:46,612 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,612 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:46,612 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,612 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:46,614 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:46,615 DEBUG (testng-Test:[]) [Test] Found key key-to-change1 with primary owner != Test-NodeA-7051, segment 184 09:58:46,615 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7c2110e3] 09:58:46,617 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:46,622 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:46,622 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:46,625 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:58:46,625 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,626 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,627 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:46,632 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,632 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,632 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:46,636 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89049] on Test-NodeB-10318 09:58:46,636 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #66, conn_id=1) 09:58:46,637 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89049, rsp_expected=true, UNICAST3: DATA, seqno=66, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,639 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,639 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89049, rsp_expected=true, UNICAST3: DATA, seqno=66, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #66, conn_id=1) 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#66 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89049 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:36256. timeout=10000 (MILLISECONDS) 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36256. Timeout=10000 (MILLISECONDS) 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36256} 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36256}. Current=null 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36256}) => true 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36256}. WAITING => ACQUIRED 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36256} successfully acquired the lock. 09:58:46,640 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,642 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,644 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,650 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3de16a79] 09:58:46,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:58:46,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:36256. timeout=10000 (MILLISECONDS) 09:58:46,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36256. Timeout=10000 (MILLISECONDS) 09:58:46,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36256} 09:58:46,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:46,655 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:46,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:46,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(736e26ea){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:46,658 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:46,658 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89055] on Test-NodeA-7051 09:58:46,658 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #68, conn_id=0) 09:58:46,658 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89055, rsp_expected=true, UNICAST3: DATA, seqno=68, TP: [cluster_name=ISPN] 09:58:46,658 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,659 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (210 bytes) 09:58:46,660 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89055, rsp_expected=true, UNICAST3: DATA, seqno=68, TP: [cluster_name=ISPN] 09:58:46,660 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #68, conn_id=0) 09:58:46,660 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#68 09:58:46,660 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89055 09:58:46,660 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:46,660 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,660 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@24f60030] 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(558ccbeb){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(558ccbeb){key=key-to-change1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=initial-value} in container 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89055 to Test-NodeB-10318 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #67, conn_id=1) 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89055, rsp_expected=true, UNICAST3: DATA, seqno=67, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36256 09:58:46,661 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,661 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:46,671 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89055, rsp_expected=true, UNICAST3: DATA, seqno=67, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,671 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #67, conn_id=1) 09:58:46,678 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#67 09:58:46,679 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,679 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(736e26ea){key=key-to-change1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=initial-value} in container 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:36256 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36256. 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36256}. ACQUIRED => RELEASED 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36256}? true 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36256} 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36256}, null) => true 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89049 to Test-NodeA-7051 09:58:46,679 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #69, conn_id=0) 09:58:46,687 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89049, rsp_expected=true, UNICAST3: DATA, seqno=69, TP: [cluster_name=ISPN] 09:58:46,688 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,688 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:46,688 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:36256 09:58:46,688 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89049, rsp_expected=true, UNICAST3: DATA, seqno=69, TP: [cluster_name=ISPN] 09:58:46,688 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #69, conn_id=0) 09:58:46,688 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#69 09:58:46,688 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,689 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:46,702 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:46,714 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1a665e61] 09:58:46,716 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,716 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:46,717 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change1 for read. Entry=ImmortalCacheEntry{key=key-to-change1, value=initial-value} 09:58:46,717 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:46,717 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:46,717 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1b49cbf7] 09:58:46,717 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:46,717 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:46,717 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change1 for read. Entry=ImmortalCacheEntry{key=key-to-change1, value=initial-value} 09:58:46,717 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:46,717 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:46,717 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_close_iter_invoked * 1 09:58:46,717 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:46,718 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 4c35043f-8e5f-46bb-885b-34c7ea4a3ec1 09:58:46,720 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@6cbbe7c3[Not completed] to remote execution at node Test-NodeB-10318 09:58:46,720 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@205999c8] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,720 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@205999c8], mode=SYNCHRONOUS, timeout=15000 09:58:46,720 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@205999c8] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:46,720 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89062] on Test-NodeB-10318 09:58:46,720 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #68, conn_id=1) 09:58:46,720 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89062, rsp_expected=true, UNICAST3: DATA, seqno=68, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,721 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,721 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@17858325[Not completed] to remote execution at node Test-NodeC-52778 09:58:46,721 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@205999c8] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,721 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@205999c8], mode=SYNCHRONOUS, timeout=15000 09:58:46,721 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@205999c8] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:46,721 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89063] on Test-NodeC-52778 09:58:46,721 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #119, conn_id=2) 09:58:46,721 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89063, rsp_expected=true, UNICAST3: DATA, seqno=119, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,721 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:46,743 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89062, rsp_expected=true, UNICAST3: DATA, seqno=68, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,743 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #68, conn_id=1) 09:58:46,743 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#68 09:58:46,743 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89062 09:58:46,742 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,743 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@408c1b5a] [sender=Test-NodeA-7051] 09:58:46,743 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:46,756 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89063, rsp_expected=true, UNICAST3: DATA, seqno=119, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,756 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #119, conn_id=2) 09:58:46,755 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:46,756 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@408c1b5a] 09:58:46,756 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 4c35043f-8e5f-46bb-885b-34c7ea4a3ec1 09:58:46,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@408c1b5a] 09:58:46,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89062 to Test-NodeA-7051 09:58:46,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #70, conn_id=0) 09:58:46,776 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89062, rsp_expected=true, UNICAST3: DATA, seqno=70, TP: [cluster_name=ISPN] 09:58:46,776 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,777 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:46,778 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89062, rsp_expected=true, UNICAST3: DATA, seqno=70, TP: [cluster_name=ISPN] 09:58:46,778 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #70, conn_id=0) 09:58:46,778 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#70 09:58:46,778 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,778 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@205999c8] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:46,756 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#119 09:58:46,779 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89063 09:58:46,788 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6a88095] [sender=Test-NodeA-7051] 09:58:46,788 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:46,789 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,789 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6a88095] 09:58:46,805 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 4c35043f-8e5f-46bb-885b-34c7ea4a3ec1 09:58:46,805 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6a88095] 09:58:46,818 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89063 to Test-NodeA-7051 09:58:46,818 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #122, conn_id=0) 09:58:46,819 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89063, rsp_expected=true, UNICAST3: DATA, seqno=122, TP: [cluster_name=ISPN] 09:58:46,819 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,827 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:46,828 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89063, rsp_expected=true, UNICAST3: DATA, seqno=122, TP: [cluster_name=ISPN] 09:58:46,828 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #122, conn_id=0) 09:58:46,828 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#122 09:58:46,828 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:46,828 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@205999c8] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:46,828 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 4c35043f-8e5f-46bb-885b-34c7ea4a3ec1 requests initial state for cache 09:58:46,828 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@10b1640b] 09:58:46,828 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:46,830 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:46,830 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70516 09:58:46,830 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70516 excluding keys [] 09:58:46,830 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,830 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:46,832 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:46,832 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:46,834 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89076] on Test-NodeB-10318 09:58:46,834 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #69, conn_id=1) 09:58:46,834 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89076, rsp_expected=true, UNICAST3: DATA, seqno=69, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,834 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,836 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:46,837 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89076, rsp_expected=true, UNICAST3: DATA, seqno=69, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,837 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #69, conn_id=1) 09:58:46,837 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#69 09:58:46,839 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89076 09:58:46,840 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:46,840 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,840 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,840 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:46,841 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70516 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:46,841 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@4ae8445d] 09:58:46,841 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:46,841 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70516 09:58:46,841 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70516 09:58:46,841 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70516 09:58:46,841 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:46,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70516 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:46,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70516 09:58:46,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:46,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:46,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89079] on Test-NodeA-7051 09:58:46,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #71, conn_id=0) 09:58:46,844 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89079, rsp_expected=true, UNICAST3: DATA, seqno=71, TP: [cluster_name=ISPN] 09:58:46,857 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (257 bytes (1285.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,857 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (260 bytes) 09:58:46,857 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=183 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89079, rsp_expected=true, UNICAST3: DATA, seqno=71, TP: [cluster_name=ISPN] 09:58:46,862 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #71, conn_id=0) 09:58:46,862 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#71 09:58:46,862 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89079 09:58:46,863 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:46,863 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:46,863 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,863 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:46,863 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70516 with [] suspected segments. 09:58:46,863 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:46,863 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 3 09:58:46,863 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:46,863 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89079 to Test-NodeB-10318 09:58:46,863 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #70, conn_id=1) 09:58:46,863 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89079, rsp_expected=true, UNICAST3: DATA, seqno=70, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,863 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:46,863 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:46,863 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89079, rsp_expected=true, UNICAST3: DATA, seqno=70, conn_id=1, TP: [cluster_name=ISPN] 09:58:46,868 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #70, conn_id=1) 09:58:46,868 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#70 09:58:46,868 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:46,868 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:46,868 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:46,868 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89076 to Test-NodeA-7051 09:58:46,868 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #72, conn_id=0) 09:58:46,868 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89076, rsp_expected=true, UNICAST3: DATA, seqno=72, TP: [cluster_name=ISPN] 09:58:46,868 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,868 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:46,868 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89076, rsp_expected=true, UNICAST3: DATA, seqno=72, TP: [cluster_name=ISPN] 09:58:46,868 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #72, conn_id=0) 09:58:46,868 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#72 09:58:46,869 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:46,869 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:46,869 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70516 excluding keys [] 09:58:46,869 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,869 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:46,869 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:46,869 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:46,869 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89083] on Test-NodeC-52778 09:58:46,869 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #120, conn_id=2) 09:58:46,869 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89083, rsp_expected=true, UNICAST3: DATA, seqno=120, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,870 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,871 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:46,872 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89083, rsp_expected=true, UNICAST3: DATA, seqno=120, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,872 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #120, conn_id=2) 09:58:46,872 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#120 09:58:46,872 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89083 09:58:46,872 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:46,872 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:46,872 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:46,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70516 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:46,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@c038d26] 09:58:46,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:46,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70516 09:58:46,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70516 09:58:46,873 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70516 09:58:46,873 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:46,873 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70516 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:46,874 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70516 09:58:46,874 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:46,874 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:46,874 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:46,874 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89084] on Test-NodeA-7051 09:58:46,874 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #123, conn_id=0) 09:58:46,874 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89084, rsp_expected=true, UNICAST3: DATA, seqno=123, TP: [cluster_name=ISPN] 09:58:46,874 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,874 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:46,875 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89084, rsp_expected=true, UNICAST3: DATA, seqno=123, TP: [cluster_name=ISPN] 09:58:46,875 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #123, conn_id=0) 09:58:46,875 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#123 09:58:46,877 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89084 09:58:46,877 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:46,877 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:46,886 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:46,887 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:46,887 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70516 with [] suspected segments. 09:58:46,887 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:46,887 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:46,887 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70516 as completed! 09:58:46,891 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:46,897 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89084 to Test-NodeC-52778 09:58:46,901 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #121, conn_id=2) 09:58:46,903 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89084, rsp_expected=true, UNICAST3: DATA, seqno=121, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,903 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:46,904 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:46,904 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89084, rsp_expected=true, UNICAST3: DATA, seqno=121, conn_id=2, TP: [cluster_name=ISPN] 09:58:46,904 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #121, conn_id=2) 09:58:46,904 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#121 09:58:46,904 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:46,905 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:46,905 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:46,906 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89083 to Test-NodeA-7051 09:58:46,908 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #124, conn_id=0) 09:58:46,908 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89083, rsp_expected=true, UNICAST3: DATA, seqno=124, TP: [cluster_name=ISPN] 09:58:46,908 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:46,910 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:46,911 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89083, rsp_expected=true, UNICAST3: DATA, seqno=124, TP: [cluster_name=ISPN] 09:58:46,911 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #124, conn_id=0) 09:58:46,911 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#124 09:58:46,911 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:46,912 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:46,913 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:46,913 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-70516 09:58:46,913 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:46,913 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:46,913 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70516 09:58:46,915 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70516 being completed: true 09:58:46,915 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70516 09:58:47,050 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #70) 09:58:46,915 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:47,050 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=70, conn_id=1, ts=40, TP: [cluster_name=ISPN] 09:58:47,050 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #121) 09:58:46,964 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #72) 09:58:47,055 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=72, ts=46, TP: [cluster_name=ISPN] 09:58:47,055 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,056 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:47,056 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=72, ts=46, TP: [cluster_name=ISPN] 09:58:47,056 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #72, conn-id=0, ts=46) 09:58:47,055 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #124) 09:58:47,052 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=121, conn_id=2, ts=40, TP: [cluster_name=ISPN] 09:58:47,051 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:47,058 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,058 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:47,059 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=70, conn_id=1, ts=40, TP: [cluster_name=ISPN] 09:58:47,056 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=124, ts=47, TP: [cluster_name=ISPN] 09:58:47,059 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,059 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:47,059 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #70, conn-id=1, ts=40) 09:58:47,058 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,058 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:47,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:47,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:47,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:47,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:47,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:47,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:47,060 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:47,065 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=121, conn_id=2, ts=40, TP: [cluster_name=ISPN] 09:58:47,066 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #121, conn-id=2, ts=40) 09:58:47,060 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=124, ts=47, TP: [cluster_name=ISPN] 09:58:47,066 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #124, conn-id=0, ts=47) 09:58:47,061 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:47,068 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,075 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,075 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:47,075 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:47,075 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:47,075 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,075 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,075 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,075 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,075 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,076 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,076 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,076 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:47,076 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:47,076 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:47,076 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:47,076 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:47,076 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:47,076 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:47,076 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:47,076 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:47,076 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_close_iter_invoked * 1 (available = 1, total = 1) 09:58:47,076 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_close_iter_released * 1 09:58:47,076 TRACE (testng-Test:[]) [CheckPoint] Received event pre_close_iter_invoked * 1 (available = 0, total = 1) 09:58:47,081 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7beea0a5] 09:58:47,081 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:47,084 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:47,084 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:47,085 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:58:47,085 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,086 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,086 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:47,086 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,086 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,086 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:47,086 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89099] on Test-NodeB-10318 09:58:47,086 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #71, conn_id=1) 09:58:47,086 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89099, rsp_expected=true, UNICAST3: DATA, seqno=71, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,086 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,087 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:47,088 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89099, rsp_expected=true, UNICAST3: DATA, seqno=71, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,088 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #71, conn_id=1) 09:58:47,088 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#71 09:58:47,088 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89099 09:58:47,088 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:47,088 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,088 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:36291. timeout=10000 (MILLISECONDS) 09:58:47,088 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36291. Timeout=10000 (MILLISECONDS) 09:58:47,089 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36291} 09:58:47,094 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36291}. Current=null 09:58:47,094 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36291}) => true 09:58:47,094 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36291}. WAITING => ACQUIRED 09:58:47,094 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36291} successfully acquired the lock. 09:58:47,094 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,094 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,094 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,096 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@65d59194] 09:58:47,096 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:58:47,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:36291. timeout=10000 (MILLISECONDS) 09:58:47,103 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36291. Timeout=10000 (MILLISECONDS) 09:58:47,103 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36291} 09:58:47,104 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:47,104 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:47,108 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,108 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:47,110 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:47,110 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(33a2e30c){key=key-to-change1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:47,112 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,113 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,118 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:47,119 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89107] on Test-NodeA-7051 09:58:47,121 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #73, conn_id=0) 09:58:47,121 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89107, rsp_expected=true, UNICAST3: DATA, seqno=73, TP: [cluster_name=ISPN] 09:58:47,121 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,124 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (210 bytes) 09:58:47,125 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89107, rsp_expected=true, UNICAST3: DATA, seqno=73, TP: [cluster_name=ISPN] 09:58:47,125 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #73, conn_id=0) 09:58:47,125 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#73 09:58:47,131 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89107 09:58:47,136 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:47,136 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,136 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,136 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2e2c06e5] 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1d4c5358){key=key-to-change1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1d4c5358){key=key-to-change1, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change1, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=changed-value} in container 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89107 to Test-NodeB-10318 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #72, conn_id=1) 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89107, rsp_expected=true, UNICAST3: DATA, seqno=72, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,178 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36291 09:58:47,178 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,178 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (96 bytes) 09:58:47,183 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89107, rsp_expected=true, UNICAST3: DATA, seqno=72, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,183 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #72, conn_id=1) 09:58:47,183 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#72 09:58:47,193 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:47,193 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=initial-value} } 09:58:47,202 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(33a2e30c){key=key-to-change1, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,202 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:47,202 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,202 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,202 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change1, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:47,202 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=changed-value} in container 09:58:47,202 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_MODIFIED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, key=key-to-change1, value=changed-value, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:58:47,202 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5854efed[Not completed] to remote execution at node Test-NodeA-7051 09:58:47,211 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@4afdf824] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,211 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@4afdf824], mode=SYNCHRONOUS, timeout=15000 09:58:47,213 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@4afdf824] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:47,213 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89120] on Test-NodeA-7051 09:58:47,213 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #74, conn_id=0) 09:58:47,213 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89120, rsp_expected=true, UNICAST3: DATA, seqno=74, TP: [cluster_name=ISPN] 09:58:47,213 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (378 bytes (1890.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,213 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (381 bytes) 09:58:47,228 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=304 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89120, rsp_expected=true, UNICAST3: DATA, seqno=74, TP: [cluster_name=ISPN] 09:58:47,228 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #74, conn_id=0) 09:58:47,228 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#74 09:58:47,228 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89120 09:58:47,228 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@4d416a12] [sender=Test-NodeB-10318] 09:58:47,234 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:47,235 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@4d416a12] 09:58:47,235 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,246 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_MODIFIED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=changed-value, oldValue=null, transaction=null, retryCommand=false, origin=Test-NodeB-10318}], notifying cluster listener with id 4c35043f-8e5f-46bb-885b-34c7ea4a3ec1 09:58:47,246 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Listener received event ClusterEvent {type=CACHE_ENTRY_MODIFIED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=changed-value, oldValue=null, transaction=null, retryCommand=false, origin=Test-NodeB-10318} 09:58:47,247 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@4d416a12] 09:58:47,247 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89120 to Test-NodeB-10318 09:58:47,247 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #73, conn_id=1) 09:58:47,247 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89120, rsp_expected=true, UNICAST3: DATA, seqno=73, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,251 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,251 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:47,254 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89120, rsp_expected=true, UNICAST3: DATA, seqno=73, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,258 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #73, conn_id=1) 09:58:47,258 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#73 09:58:47,258 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,258 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@4afdf824] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:47,259 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:47,261 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:36291 09:58:47,261 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36291. 09:58:47,261 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36291}. ACQUIRED => RELEASED 09:58:47,261 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36291}? true 09:58:47,261 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36291} 09:58:47,261 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36291}, null) => true 09:58:47,261 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:47,261 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,262 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89099 to Test-NodeA-7051 09:58:47,262 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #75, conn_id=0) 09:58:47,262 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89099, rsp_expected=true, UNICAST3: DATA, seqno=75, TP: [cluster_name=ISPN] 09:58:47,262 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:36291 09:58:47,262 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,262 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:58:47,263 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89099, rsp_expected=true, UNICAST3: DATA, seqno=75, TP: [cluster_name=ISPN] 09:58:47,263 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #75, conn_id=0) 09:58:47,264 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#75 09:58:47,265 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:47,265 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:58:47,265 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:47,265 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_close_iter_released * 999999999 (available = 999999999, total = 999999999) 09:58:47,265 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_close_iter_released * 1 (available = 999999998, total = 999999999) 09:58:47,276 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 4c35043f-8e5f-46bb-885b-34c7ea4a3ec1 initial state for cache completed 09:58:47,276 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:47,276 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:47,276 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:47,276 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@6153a59a[Not completed] to self 09:58:47,277 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@79a04c07[Not completed] to remote execution at node Test-NodeB-10318 09:58:47,280 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6b058178] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,280 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6b058178], mode=SYNCHRONOUS, timeout=15000 09:58:47,280 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6b058178] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:47,280 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89133] on Test-NodeB-10318 09:58:47,280 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #74, conn_id=1) 09:58:47,280 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89133, rsp_expected=true, UNICAST3: DATA, seqno=74, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,280 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@6ef3fa69[Not completed] to remote execution at node Test-NodeC-52778 09:58:47,282 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,286 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:47,288 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89133, rsp_expected=true, UNICAST3: DATA, seqno=74, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,288 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #74, conn_id=1) 09:58:47,288 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#74 09:58:47,288 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89133 09:58:47,288 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4db5d11b] [sender=Test-NodeA-7051] 09:58:47,289 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:47,289 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4db5d11b] 09:58:47,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 4c35043f-8e5f-46bb-885b-34c7ea4a3ec1 09:58:47,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4db5d11b] 09:58:47,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89133 to Test-NodeA-7051 09:58:47,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #76, conn_id=0) 09:58:47,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89133, rsp_expected=true, UNICAST3: DATA, seqno=76, TP: [cluster_name=ISPN] 09:58:47,289 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,289 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:47,289 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89133, rsp_expected=true, UNICAST3: DATA, seqno=76, TP: [cluster_name=ISPN] 09:58:47,289 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #76, conn_id=0) 09:58:47,289 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#76 09:58:47,289 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,289 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6b058178] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:47,280 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6b058178] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,291 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6b058178], mode=SYNCHRONOUS, timeout=15000 09:58:47,292 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6b058178] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:47,292 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89137] on Test-NodeC-52778 09:58:47,297 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #122, conn_id=2) 09:58:47,297 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89137, rsp_expected=true, UNICAST3: DATA, seqno=122, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,298 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,298 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:47,298 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89137, rsp_expected=true, UNICAST3: DATA, seqno=122, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,304 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #122, conn_id=2) 09:58:47,305 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#122 09:58:47,305 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89137 09:58:47,308 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@262ed971] [sender=Test-NodeA-7051] 09:58:47,308 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:47,308 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,309 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@262ed971] 09:58:47,309 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 4c35043f-8e5f-46bb-885b-34c7ea4a3ec1 09:58:47,309 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@262ed971] 09:58:47,310 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89137 to Test-NodeA-7051 09:58:47,310 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #125, conn_id=0) 09:58:47,310 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89137, rsp_expected=true, UNICAST3: DATA, seqno=125, TP: [cluster_name=ISPN] 09:58:47,313 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,314 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:47,314 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89137, rsp_expected=true, UNICAST3: DATA, seqno=125, TP: [cluster_name=ISPN] 09:58:47,315 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #125, conn_id=0) 09:58:47,315 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#125 09:58:47,315 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,317 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6b058178] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:47,317 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndCompletedSegmentValueNonOwnerClustered 09:58:47,318 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:47,318 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:47,320 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:47,329 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:47,332 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:47,333 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:47,333 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:47,333 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:47,333 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:47,333 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:47,333 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:47,333 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:47,333 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:47,343 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:47,343 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndCompletedSegmentValueOwnerClustered 09:58:47,345 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@71d05c37] 09:58:47,345 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:47,345 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:47,347 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:47,348 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:47,350 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,352 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,352 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:47,352 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,352 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,352 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:47,352 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89149] on Test-NodeB-10318 09:58:47,352 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #75, conn_id=1) 09:58:47,352 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89149, rsp_expected=true, UNICAST3: DATA, seqno=75, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,352 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,352 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:47,354 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89149, rsp_expected=true, UNICAST3: DATA, seqno=75, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,354 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #75, conn_id=1) 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#75 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89149 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:36317. timeout=10000 (MILLISECONDS) 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36317. Timeout=10000 (MILLISECONDS) 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36317} 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36317}. Current=null 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36317}) => true 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36317}. WAITING => ACQUIRED 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36317} successfully acquired the lock. 09:58:47,357 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,358 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,358 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,359 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2f6a65c9] 09:58:47,359 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,361 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:36317. timeout=10000 (MILLISECONDS) 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36317. Timeout=10000 (MILLISECONDS) 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36317} 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(c8867fc){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,364 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,364 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:47,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89152] on Test-NodeC-52778 09:58:47,365 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #31, conn_id=1) 09:58:47,371 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89152, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,372 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,372 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:47,373 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89152, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,373 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #31, conn_id=1) 09:58:47,373 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#31 09:58:47,373 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89152 09:58:47,374 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:47,375 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,376 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@158fe9b] 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(729a0ef4){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(729a0ef4){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89152 to Test-NodeB-10318 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #31, conn_id=1) 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89152, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,376 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36317 09:58:47,379 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,379 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:47,379 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89152, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,379 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #31, conn_id=1) 09:58:47,381 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#31 09:58:47,382 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,382 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:47,384 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(c8867fc){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,384 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:47,384 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,386 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,388 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:36317 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36317. 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36317}. ACQUIRED => RELEASED 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36317}? true 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36317} 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36317}, null) => true 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89149 to Test-NodeA-7051 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #77, conn_id=0) 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89149, rsp_expected=true, UNICAST3: DATA, seqno=77, TP: [cluster_name=ISPN] 09:58:47,393 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:36317 09:58:47,393 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,395 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:47,395 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89149, rsp_expected=true, UNICAST3: DATA, seqno=77, TP: [cluster_name=ISPN] 09:58:47,396 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #77, conn_id=0) 09:58:47,396 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#77 09:58:47,396 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,397 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:47,398 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,401 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2483c771] 09:58:47,401 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:47,401 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:47,401 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:47,401 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:47,401 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,401 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,401 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:47,401 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,401 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,401 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:47,401 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89157] on Test-NodeC-52778 09:58:47,401 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #123, conn_id=2) 09:58:47,401 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89157, rsp_expected=true, UNICAST3: DATA, seqno=123, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,401 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,401 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:47,403 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89157, rsp_expected=true, UNICAST3: DATA, seqno=123, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,403 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #123, conn_id=2) 09:58:47,404 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#123 09:58:47,407 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89157 09:58:47,407 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36322. timeout=10000 (MILLISECONDS) 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36322. Timeout=10000 (MILLISECONDS) 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36322} 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36322}. Current=null 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36322}) => true 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36322}. WAITING => ACQUIRED 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36322} successfully acquired the lock. 09:58:47,408 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@76e007b4] 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36322. timeout=10000 (MILLISECONDS) 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36322. Timeout=10000 (MILLISECONDS) 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36322} 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7f01e9d){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,408 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:47,409 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89159] on Test-NodeA-7051 09:58:47,409 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #126, conn_id=0) 09:58:47,414 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89159, rsp_expected=true, UNICAST3: DATA, seqno=126, TP: [cluster_name=ISPN] 09:58:47,414 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,431 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:47,435 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89159, rsp_expected=true, UNICAST3: DATA, seqno=126, TP: [cluster_name=ISPN] 09:58:47,439 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #126, conn_id=0) 09:58:47,446 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#126 09:58:47,449 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89159 09:58:47,449 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:47,453 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,453 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,453 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,458 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,460 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@e062b2b] 09:58:47,461 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,462 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:47,465 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:47,467 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:47,467 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,473 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:47,473 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(71af7f20){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,495 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,495 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,495 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(71af7f20){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:47,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,497 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:47,497 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:47,497 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,499 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,499 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89159 to Test-NodeC-52778 09:58:47,503 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #124, conn_id=2) 09:58:47,505 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89159, rsp_expected=true, UNICAST3: DATA, seqno=124, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,506 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36322 09:58:47,506 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,506 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:47,506 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89159, rsp_expected=true, UNICAST3: DATA, seqno=124, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,509 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #124, conn_id=2) 09:58:47,509 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#124 09:58:47,509 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,509 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:47,509 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7f01e9d){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,509 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:47,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,524 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:47,524 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:47,524 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36322 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36322. 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36322}. ACQUIRED => RELEASED 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36322}? true 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36322} 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36322}, null) => true 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89157 to Test-NodeA-7051 09:58:47,533 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #127, conn_id=0) 09:58:47,533 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89157, rsp_expected=true, UNICAST3: DATA, seqno=127, TP: [cluster_name=ISPN] 09:58:47,533 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36322 09:58:47,533 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,533 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:47,534 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89157, rsp_expected=true, UNICAST3: DATA, seqno=127, TP: [cluster_name=ISPN] 09:58:47,534 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #127, conn_id=0) 09:58:47,540 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#127 09:58:47,540 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,543 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:47,543 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,558 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #75) 09:58:47,558 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=75, conn_id=1, ts=41, TP: [cluster_name=ISPN] 09:58:47,558 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #31) 09:58:47,551 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7c235011] 09:58:47,559 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:47,558 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,558 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=31, conn_id=1, ts=42, TP: [cluster_name=ISPN] 09:58:47,560 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #31) 09:58:47,559 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #77) 09:58:47,559 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:47,559 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:47,563 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=75, conn_id=1, ts=41, TP: [cluster_name=ISPN] 09:58:47,563 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #75, conn-id=1, ts=41) 09:58:47,563 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:47,563 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,563 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=77, ts=48, TP: [cluster_name=ISPN] 09:58:47,563 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=31, conn_id=1, ts=41, TP: [cluster_name=ISPN] 09:58:47,563 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,563 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #124) 09:58:47,563 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,563 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #127) 09:58:47,570 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=127, ts=49, TP: [cluster_name=ISPN] 09:58:47,563 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:47,563 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:47,571 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,571 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,568 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=124, conn_id=2, ts=42, TP: [cluster_name=ISPN] 09:58:47,568 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:47,572 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=31, conn_id=1, ts=41, TP: [cluster_name=ISPN] 09:58:47,572 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #31, conn-id=1, ts=41) 09:58:47,571 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,578 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:47,571 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=31, conn_id=1, ts=42, TP: [cluster_name=ISPN] 09:58:47,578 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #31, conn-id=1, ts=42) 09:58:47,579 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=124, conn_id=2, ts=42, TP: [cluster_name=ISPN] 09:58:47,579 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #124, conn-id=2, ts=42) 09:58:47,571 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:47,571 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:47,579 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,579 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=77, ts=48, TP: [cluster_name=ISPN] 09:58:47,579 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,581 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:47,582 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=127, ts=49, TP: [cluster_name=ISPN] 09:58:47,582 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #127, conn-id=0, ts=49) 09:58:47,579 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,582 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:47,582 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89196] on Test-NodeC-52778 09:58:47,582 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #77, conn-id=0, ts=48) 09:58:47,582 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #125, conn_id=2) 09:58:47,587 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89196, rsp_expected=true, UNICAST3: DATA, seqno=125, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,587 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,592 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:47,592 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89196, rsp_expected=true, UNICAST3: DATA, seqno=125, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,592 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #125, conn_id=2) 09:58:47,592 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#125 09:58:47,594 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89196 09:58:47,595 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:47,597 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,597 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36335. timeout=10000 (MILLISECONDS) 09:58:47,600 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36335. Timeout=10000 (MILLISECONDS) 09:58:47,601 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36335} 09:58:47,601 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36335}. Current=null 09:58:47,601 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36335}) => true 09:58:47,601 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36335}. WAITING => ACQUIRED 09:58:47,601 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36335} successfully acquired the lock. 09:58:47,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,613 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4a315cc5] 09:58:47,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,619 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:47,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36335. timeout=10000 (MILLISECONDS) 09:58:47,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36335. Timeout=10000 (MILLISECONDS) 09:58:47,628 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36335} 09:58:47,628 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:47,628 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:47,628 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,630 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,630 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:47,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2a61ac04){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,637 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,637 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,637 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,644 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:47,647 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89209] on Test-NodeB-10318 09:58:47,648 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #32, conn_id=1) 09:58:47,650 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89209, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,651 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,652 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:47,653 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89209, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,653 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #32, conn_id=1) 09:58:47,653 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#32 09:58:47,653 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89209 09:58:47,653 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:47,653 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,654 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1479f743] 09:58:47,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:47,659 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:47,661 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:47,661 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,663 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:47,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3306b136){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,668 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,668 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,669 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3306b136){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,669 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:47,669 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89209 to Test-NodeC-52778 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #32, conn_id=1) 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89209, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,670 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36335 09:58:47,670 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,670 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:47,670 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89209, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,676 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #32, conn_id=1) 09:58:47,676 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#32 09:58:47,678 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,678 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:47,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2a61ac04){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36335 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36335. 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36335}. ACQUIRED => RELEASED 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36335}? true 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36335} 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36335}, null) => true 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89196 to Test-NodeA-7051 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #128, conn_id=0) 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89196, rsp_expected=true, UNICAST3: DATA, seqno=128, TP: [cluster_name=ISPN] 09:58:47,681 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36335 09:58:47,681 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,682 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:47,683 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89196, rsp_expected=true, UNICAST3: DATA, seqno=128, TP: [cluster_name=ISPN] 09:58:47,683 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #128, conn_id=0) 09:58:47,683 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#128 09:58:47,683 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,683 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:47,683 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,684 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2d9c9129] 09:58:47,684 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:47,685 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:47,685 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:47,686 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:47,686 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,687 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,687 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:47,688 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,688 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,688 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:47,689 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89220] on Test-NodeC-52778 09:58:47,690 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #126, conn_id=2) 09:58:47,690 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89220, rsp_expected=true, UNICAST3: DATA, seqno=126, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,690 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,690 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:47,693 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89220, rsp_expected=true, UNICAST3: DATA, seqno=126, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,694 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #126, conn_id=2) 09:58:47,694 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#126 09:58:47,695 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89220 09:58:47,696 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:47,698 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,698 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36347. timeout=10000 (MILLISECONDS) 09:58:47,700 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36347. Timeout=10000 (MILLISECONDS) 09:58:47,700 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36347} 09:58:47,701 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36347}. Current=null 09:58:47,701 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36347}) => true 09:58:47,701 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36347}. WAITING => ACQUIRED 09:58:47,701 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36347} successfully acquired the lock. 09:58:47,706 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@74a91384] 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36347. timeout=10000 (MILLISECONDS) 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36347. Timeout=10000 (MILLISECONDS) 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36347} 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5d43c418){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,706 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,709 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:47,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89228] on Test-NodeB-10318 09:58:47,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #33, conn_id=1) 09:58:47,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89228, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,712 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,712 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:47,712 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89228, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,712 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #33, conn_id=1) 09:58:47,712 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#33 09:58:47,714 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89228 09:58:47,717 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:47,721 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,733 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,733 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,735 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,735 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1af2b9cf] 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(72a0f6ba){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(72a0f6ba){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89228 to Test-NodeC-52778 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #33, conn_id=1) 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89228, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,737 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36347 09:58:47,737 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,737 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:47,737 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89228, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,739 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #33, conn_id=1) 09:58:47,739 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#33 09:58:47,739 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,739 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:47,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5d43c418){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,744 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:47,744 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,747 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,747 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:47,752 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:47,752 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,752 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36347 09:58:47,753 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36347. 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36347}. ACQUIRED => RELEASED 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36347}? true 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36347} 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36347}, null) => true 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89220 to Test-NodeA-7051 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #129, conn_id=0) 09:58:47,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89220, rsp_expected=true, UNICAST3: DATA, seqno=129, TP: [cluster_name=ISPN] 09:58:47,758 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36347 09:58:47,758 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,758 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:47,758 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89220, rsp_expected=true, UNICAST3: DATA, seqno=129, TP: [cluster_name=ISPN] 09:58:47,758 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #129, conn_id=0) 09:58:47,761 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#129 09:58:47,762 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,762 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:47,764 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,764 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@175bbe1d] 09:58:47,765 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:47,765 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:47,769 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:47,769 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:47,771 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,771 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,771 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:47,773 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,773 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,773 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:47,773 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89240] on Test-NodeC-52778 09:58:47,773 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #127, conn_id=2) 09:58:47,773 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89240, rsp_expected=true, UNICAST3: DATA, seqno=127, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,773 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,773 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89240, rsp_expected=true, UNICAST3: DATA, seqno=127, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #127, conn_id=2) 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#127 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89240 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36356. timeout=10000 (MILLISECONDS) 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36356. Timeout=10000 (MILLISECONDS) 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36356} 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36356}. Current=null 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36356}) => true 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36356}. WAITING => ACQUIRED 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36356} successfully acquired the lock. 09:58:47,774 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5a10bdb7] 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36356. timeout=10000 (MILLISECONDS) 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36356. Timeout=10000 (MILLISECONDS) 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36356} 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(a1c39a9){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:47,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89241] on Test-NodeA-7051 09:58:47,775 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #130, conn_id=0) 09:58:47,775 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89241, rsp_expected=true, UNICAST3: DATA, seqno=130, TP: [cluster_name=ISPN] 09:58:47,775 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,775 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:47,775 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89241, rsp_expected=true, UNICAST3: DATA, seqno=130, TP: [cluster_name=ISPN] 09:58:47,775 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #130, conn_id=0) 09:58:47,777 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#130 09:58:47,779 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89241 09:58:47,779 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:47,779 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,795 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,795 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,795 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1b5261df] 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(43eed089){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,797 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(43eed089){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89241 to Test-NodeC-52778 09:58:47,799 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #128, conn_id=2) 09:58:47,800 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89241, rsp_expected=true, UNICAST3: DATA, seqno=128, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,800 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,800 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36356 09:58:47,800 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:47,802 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89241, rsp_expected=true, UNICAST3: DATA, seqno=128, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,803 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #128, conn_id=2) 09:58:47,804 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#128 09:58:47,811 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,811 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:47,812 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(a1c39a9){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,812 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:47,812 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,813 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,813 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:47,813 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:47,813 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,813 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36356 09:58:47,814 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36356. 09:58:47,814 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36356}. ACQUIRED => RELEASED 09:58:47,815 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36356}? true 09:58:47,816 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36356} 09:58:47,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36356}, null) => true 09:58:47,822 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:47,822 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,823 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89240 to Test-NodeA-7051 09:58:47,823 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #131, conn_id=0) 09:58:47,826 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89240, rsp_expected=true, UNICAST3: DATA, seqno=131, TP: [cluster_name=ISPN] 09:58:47,827 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36356 09:58:47,827 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,828 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:47,828 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89240, rsp_expected=true, UNICAST3: DATA, seqno=131, TP: [cluster_name=ISPN] 09:58:47,828 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #131, conn_id=0) 09:58:47,828 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#131 09:58:47,828 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,835 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:47,836 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,836 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5b131bdc] 09:58:47,836 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:47,836 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:47,836 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:36363. timeout=10000 (MILLISECONDS) 09:58:47,836 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36363. Timeout=10000 (MILLISECONDS) 09:58:47,836 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36363} 09:58:47,836 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36363}. Current=null 09:58:47,836 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36363}) => true 09:58:47,837 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36363}. WAITING => ACQUIRED 09:58:47,837 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36363} successfully acquired the lock. 09:58:47,837 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:47,838 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:47,842 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,849 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,849 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:47,853 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(60ae7cc9){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,853 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,853 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,853 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:47,854 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,854 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,855 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:47,855 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89253] on Test-NodeB-10318 09:58:47,855 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #76, conn_id=1) 09:58:47,855 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89253, rsp_expected=true, UNICAST3: DATA, seqno=76, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,855 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:47,855 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:47,855 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89253, rsp_expected=true, UNICAST3: DATA, seqno=76, conn_id=1, TP: [cluster_name=ISPN] 09:58:47,855 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #76, conn_id=1) 09:58:47,856 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#76 09:58:47,857 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89253 09:58:47,857 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:47,859 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,859 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,859 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,859 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2938d442] 09:58:47,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,861 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:47,861 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:47,862 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:47,863 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,863 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,863 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:47,863 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2fb15f52){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,863 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,944 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,944 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2fb15f52){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,949 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:47,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,952 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,955 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:47,955 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:47,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89253 to Test-NodeA-7051 09:58:47,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #78, conn_id=0) 09:58:47,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89253, rsp_expected=true, UNICAST3: DATA, seqno=78, TP: [cluster_name=ISPN] 09:58:47,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36363 09:58:47,958 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,960 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:47,960 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89253, rsp_expected=true, UNICAST3: DATA, seqno=78, TP: [cluster_name=ISPN] 09:58:47,961 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #78, conn_id=0) 09:58:47,961 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#78 09:58:47,961 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:47,961 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:47,962 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(60ae7cc9){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,962 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:47,962 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,962 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,962 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:47,963 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:47,963 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:47,963 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:36363 09:58:47,963 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36363. 09:58:47,964 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36363}. ACQUIRED => RELEASED 09:58:47,964 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36363}? true 09:58:47,964 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36363} 09:58:47,965 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36363}, null) => true 09:58:47,965 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:47,965 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2f4de78d] 09:58:47,966 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:47,966 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:47,974 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:47,975 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:47,975 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,976 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,976 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:47,976 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,976 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,979 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:47,980 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89262] on Test-NodeC-52778 09:58:47,980 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #129, conn_id=2) 09:58:47,980 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89262, rsp_expected=true, UNICAST3: DATA, seqno=129, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,980 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:47,980 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:47,981 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89262, rsp_expected=true, UNICAST3: DATA, seqno=129, conn_id=2, TP: [cluster_name=ISPN] 09:58:47,981 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #129, conn_id=2) 09:58:47,981 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#129 09:58:47,981 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89262 09:58:47,981 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:47,982 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,982 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36372. timeout=10000 (MILLISECONDS) 09:58:47,982 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36372. Timeout=10000 (MILLISECONDS) 09:58:47,982 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36372} 09:58:47,983 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36372}. Current=null 09:58:47,983 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36372}) => true 09:58:47,983 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36372}. WAITING => ACQUIRED 09:58:47,983 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36372} successfully acquired the lock. 09:58:47,983 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,983 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,984 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,985 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@d7af12] 09:58:47,985 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,985 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:47,985 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36372. timeout=10000 (MILLISECONDS) 09:58:47,985 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36372. Timeout=10000 (MILLISECONDS) 09:58:47,986 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36372} 09:58:47,986 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:47,986 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:47,987 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,987 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,988 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:47,988 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(765a54a){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,989 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,989 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,989 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:47,989 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:47,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:47,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89268] on Test-NodeA-7051 09:58:47,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #132, conn_id=0) 09:58:47,992 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89268, rsp_expected=true, UNICAST3: DATA, seqno=132, TP: [cluster_name=ISPN] 09:58:47,992 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:47,993 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:47,993 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89268, rsp_expected=true, UNICAST3: DATA, seqno=132, TP: [cluster_name=ISPN] 09:58:47,993 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #132, conn_id=0) 09:58:47,993 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#132 09:58:47,993 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89268 09:58:47,993 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:47,993 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:47,993 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7c0ef4ac] 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(76d2c272){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(76d2c272){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:47,993 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:47,995 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:47,995 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:47,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:47,998 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,002 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,002 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89268 to Test-NodeC-52778 09:58:48,003 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #130, conn_id=2) 09:58:48,004 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89268, rsp_expected=true, UNICAST3: DATA, seqno=130, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,004 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36372 09:58:48,004 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,004 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:48,005 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89268, rsp_expected=true, UNICAST3: DATA, seqno=130, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,006 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #130, conn_id=2) 09:58:48,006 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#130 09:58:48,006 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,006 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:48,007 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(765a54a){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,007 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:48,008 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,008 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,009 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:48,010 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:48,011 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,012 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36372 09:58:48,013 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36372. 09:58:48,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36372}. ACQUIRED => RELEASED 09:58:48,015 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36372}? true 09:58:48,016 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36372} 09:58:48,016 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36372}, null) => true 09:58:48,017 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,017 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,018 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89262 to Test-NodeA-7051 09:58:48,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #133, conn_id=0) 09:58:48,019 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89262, rsp_expected=true, UNICAST3: DATA, seqno=133, TP: [cluster_name=ISPN] 09:58:48,021 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,021 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36372 09:58:48,021 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89262, rsp_expected=true, UNICAST3: DATA, seqno=133, TP: [cluster_name=ISPN] 09:58:48,023 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #133, conn_id=0) 09:58:48,023 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#133 09:58:48,023 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,023 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,024 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,024 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4f42ee31] 09:58:48,024 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,024 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:48,024 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:48,024 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:48,024 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,024 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,024 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:48,024 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,024 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,024 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,024 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89281] on Test-NodeC-52778 09:58:48,024 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #131, conn_id=2) 09:58:48,024 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89281, rsp_expected=true, UNICAST3: DATA, seqno=131, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,024 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,026 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,027 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89281, rsp_expected=true, UNICAST3: DATA, seqno=131, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,027 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #131, conn_id=2) 09:58:48,027 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#131 09:58:48,027 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89281 09:58:48,028 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,028 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,028 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36382. timeout=10000 (MILLISECONDS) 09:58:48,028 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36382. Timeout=10000 (MILLISECONDS) 09:58:48,028 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36382} 09:58:48,028 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36382}. Current=null 09:58:48,029 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36382}) => true 09:58:48,029 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36382}. WAITING => ACQUIRED 09:58:48,030 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36382} successfully acquired the lock. 09:58:48,030 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,030 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,030 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,030 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5d51ec6f] 09:58:48,030 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,030 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:48,030 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36382. timeout=10000 (MILLISECONDS) 09:58:48,031 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36382. Timeout=10000 (MILLISECONDS) 09:58:48,031 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36382} 09:58:48,031 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:48,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:48,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(708af0f9){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,034 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,037 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,037 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:48,037 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89287] on Test-NodeA-7051 09:58:48,037 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #134, conn_id=0) 09:58:48,037 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89287, rsp_expected=true, UNICAST3: DATA, seqno=134, TP: [cluster_name=ISPN] 09:58:48,037 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,037 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:48,039 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89287, rsp_expected=true, UNICAST3: DATA, seqno=134, TP: [cluster_name=ISPN] 09:58:48,040 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #134, conn_id=0) 09:58:48,043 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#134 09:58:48,044 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89287 09:58:48,044 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:48,044 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,044 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,044 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,045 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7e8609ee] 09:58:48,044 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,045 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,045 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:48,046 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,046 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:48,047 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,047 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,047 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:48,047 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4bd9f42f){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,047 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4bd9f42f){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:48,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:48,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:48,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89287 to Test-NodeC-52778 09:58:48,051 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #132, conn_id=2) 09:58:48,051 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89287, rsp_expected=true, UNICAST3: DATA, seqno=132, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,053 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,053 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36382 09:58:48,055 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:48,055 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89287, rsp_expected=true, UNICAST3: DATA, seqno=132, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,055 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #132, conn_id=2) 09:58:48,055 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#132 09:58:48,055 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,055 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:48,055 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(708af0f9){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,055 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:48,056 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,056 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,058 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:48,058 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:48,059 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #76) 09:58:48,059 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=76, conn_id=1, ts=43, TP: [cluster_name=ISPN] 09:58:48,060 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #33) 09:58:48,060 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,058 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36382 09:58:48,060 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:48,061 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=33, conn_id=1, ts=44, TP: [cluster_name=ISPN] 09:58:48,061 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=76, conn_id=1, ts=43, TP: [cluster_name=ISPN] 09:58:48,061 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36382. 09:58:48,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36382}. ACQUIRED => RELEASED 09:58:48,061 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,061 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #76, conn-id=1, ts=43) 09:58:48,063 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:48,062 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36382}? true 09:58:48,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36382} 09:58:48,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36382}, null) => true 09:58:48,064 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,064 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,064 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=33, conn_id=1, ts=44, TP: [cluster_name=ISPN] 09:58:48,068 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #33, conn-id=1, ts=44) 09:58:48,067 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89281 to Test-NodeA-7051 09:58:48,068 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #135, conn_id=0) 09:58:48,068 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89281, rsp_expected=true, UNICAST3: DATA, seqno=135, TP: [cluster_name=ISPN] 09:58:48,068 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36382 09:58:48,068 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,070 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,070 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89281, rsp_expected=true, UNICAST3: DATA, seqno=135, TP: [cluster_name=ISPN] 09:58:48,070 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #135, conn_id=0) 09:58:48,070 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#135 09:58:48,070 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,070 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,070 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,070 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3701285] 09:58:48,070 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #78) 09:58:48,072 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #33) 09:58:48,072 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=33, conn_id=1, ts=43, TP: [cluster_name=ISPN] 09:58:48,072 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #132) 09:58:48,071 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=78, ts=50, TP: [cluster_name=ISPN] 09:58:48,072 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,072 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:48,072 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=132, conn_id=2, ts=44, TP: [cluster_name=ISPN] 09:58:48,072 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,073 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:48,073 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=33, conn_id=1, ts=43, TP: [cluster_name=ISPN] 09:58:48,073 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #33, conn-id=1, ts=43) 09:58:48,073 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,073 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #135) 09:58:48,073 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=135, ts=51, TP: [cluster_name=ISPN] 09:58:48,072 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:48,074 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:48,073 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:48,074 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=78, ts=50, TP: [cluster_name=ISPN] 09:58:48,073 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,074 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:48,074 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=132, conn_id=2, ts=44, TP: [cluster_name=ISPN] 09:58:48,075 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #132, conn-id=2, ts=44) 09:58:48,074 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #78, conn-id=0, ts=50) 09:58:48,074 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,074 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,075 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,075 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:48,076 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:48,076 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,076 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=135, ts=51, TP: [cluster_name=ISPN] 09:58:48,077 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #135, conn-id=0, ts=51) 09:58:48,076 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,077 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,078 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89297] on Test-NodeB-10318 09:58:48,078 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #77, conn_id=1) 09:58:48,079 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89297, rsp_expected=true, UNICAST3: DATA, seqno=77, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,079 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,080 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:48,093 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89297, rsp_expected=true, UNICAST3: DATA, seqno=77, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,094 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #77, conn_id=1) 09:58:48,094 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#77 09:58:48,094 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89297 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36394. timeout=10000 (MILLISECONDS) 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36394. Timeout=10000 (MILLISECONDS) 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36394} 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36394}. Current=null 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36394}) => true 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36394}. WAITING => ACQUIRED 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36394} successfully acquired the lock. 09:58:48,095 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2082a7aa] 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36394. timeout=10000 (MILLISECONDS) 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36394. Timeout=10000 (MILLISECONDS) 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36394} 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:48,095 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(55e29026){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,096 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,096 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,097 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,097 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,097 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,097 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89302] on Test-NodeC-52778 09:58:48,097 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #34, conn_id=1) 09:58:48,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89302, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,102 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,104 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,104 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89302, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,105 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #34, conn_id=1) 09:58:48,105 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#34 09:58:48,105 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89302 09:58:48,105 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:48,106 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,106 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,106 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,107 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,108 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1634d611] 09:58:48,108 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,109 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:48,110 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,111 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:48,111 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:48,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(26a02302){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,112 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(26a02302){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,113 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:48,120 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,128 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,131 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:48,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:48,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89302 to Test-NodeB-10318 09:58:48,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #34, conn_id=1) 09:58:48,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89302, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,132 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36394 09:58:48,132 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,133 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:48,137 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89302, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,137 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #34, conn_id=1) 09:58:48,137 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#34 09:58:48,137 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,137 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,150 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(55e29026){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,150 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:48,150 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,150 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,150 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:48,150 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:48,150 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,150 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36394 09:58:48,155 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36394. 09:58:48,157 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36394}. ACQUIRED => RELEASED 09:58:48,158 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36394}? true 09:58:48,158 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36394} 09:58:48,158 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36394}, null) => true 09:58:48,159 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,159 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,159 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89297 to Test-NodeA-7051 09:58:48,159 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #79, conn_id=0) 09:58:48,160 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89297, rsp_expected=true, UNICAST3: DATA, seqno=79, TP: [cluster_name=ISPN] 09:58:48,160 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36394 09:58:48,160 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,160 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,161 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89297, rsp_expected=true, UNICAST3: DATA, seqno=79, TP: [cluster_name=ISPN] 09:58:48,161 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #79, conn_id=0) 09:58:48,161 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#79 09:58:48,162 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,162 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,162 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,162 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2569e68d] 09:58:48,162 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,162 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:48,162 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:48,162 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:48,162 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,162 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,162 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:48,162 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,162 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,162 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,163 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89316] on Test-NodeC-52778 09:58:48,163 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #133, conn_id=2) 09:58:48,164 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89316, rsp_expected=true, UNICAST3: DATA, seqno=133, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,166 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,166 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89316, rsp_expected=true, UNICAST3: DATA, seqno=133, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #133, conn_id=2) 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#133 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89316 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36404. timeout=10000 (MILLISECONDS) 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36404. Timeout=10000 (MILLISECONDS) 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36404} 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36404}. Current=null 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36404}) => true 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36404}. WAITING => ACQUIRED 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36404} successfully acquired the lock. 09:58:48,166 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,173 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6031383e] 09:58:48,174 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,175 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:48,176 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36404. timeout=10000 (MILLISECONDS) 09:58:48,177 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36404. Timeout=10000 (MILLISECONDS) 09:58:48,178 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36404} 09:58:48,178 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,179 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:48,179 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,180 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,180 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:48,181 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3a9616f1){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,182 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,183 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,183 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,183 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:48,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89317] on Test-NodeA-7051 09:58:48,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #136, conn_id=0) 09:58:48,184 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89317, rsp_expected=true, UNICAST3: DATA, seqno=136, TP: [cluster_name=ISPN] 09:58:48,184 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,184 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:48,184 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89317, rsp_expected=true, UNICAST3: DATA, seqno=136, TP: [cluster_name=ISPN] 09:58:48,184 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #136, conn_id=0) 09:58:48,184 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#136 09:58:48,185 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89317 09:58:48,186 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:48,186 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,186 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,186 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@40f9c26c] 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,187 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:48,188 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(20d84953){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,188 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,188 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,188 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(20d84953){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,189 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:48,189 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,189 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,194 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:48,195 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:48,195 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,196 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,196 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89317 to Test-NodeC-52778 09:58:48,197 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #134, conn_id=2) 09:58:48,197 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89317, rsp_expected=true, UNICAST3: DATA, seqno=134, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,198 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,198 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:48,198 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89317, rsp_expected=true, UNICAST3: DATA, seqno=134, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,198 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #134, conn_id=2) 09:58:48,198 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#134 09:58:48,198 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,198 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3a9616f1){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36404 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36404. 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36404}. ACQUIRED => RELEASED 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36404}? true 09:58:48,199 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36404} 09:58:48,206 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36404}, null) => true 09:58:48,198 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36404 09:58:48,206 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,208 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,208 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89316 to Test-NodeA-7051 09:58:48,209 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #137, conn_id=0) 09:58:48,209 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89316, rsp_expected=true, UNICAST3: DATA, seqno=137, TP: [cluster_name=ISPN] 09:58:48,212 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36404 09:58:48,212 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,213 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,214 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89316, rsp_expected=true, UNICAST3: DATA, seqno=137, TP: [cluster_name=ISPN] 09:58:48,214 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #137, conn_id=0) 09:58:48,214 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#137 09:58:48,214 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,214 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,214 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,215 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:48,215 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:48,215 DEBUG (testng-Test:[]) [Test] Found key key-to-change0 with primary owner Test-NodeA-7051, segment 51 09:58:48,215 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6884a5ba] 09:58:48,215 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,215 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:58:48,215 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:36412. timeout=10000 (MILLISECONDS) 09:58:48,215 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36412. Timeout=10000 (MILLISECONDS) 09:58:48,215 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36412} 09:58:48,215 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36412}. Current=null 09:58:48,215 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36412}) => true 09:58:48,215 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36412}. WAITING => ACQUIRED 09:58:48,215 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36412} successfully acquired the lock. 09:58:48,215 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:48,215 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:48,215 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,215 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,215 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:48,215 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(ed54250){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,215 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,215 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,215 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:48,215 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,215 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,215 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,215 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89324] on Test-NodeB-10318 09:58:48,216 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #78, conn_id=1) 09:58:48,216 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89324, rsp_expected=true, UNICAST3: DATA, seqno=78, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,216 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,216 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:48,216 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89324, rsp_expected=true, UNICAST3: DATA, seqno=78, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,216 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #78, conn_id=1) 09:58:48,216 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#78 09:58:48,216 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89324 09:58:48,216 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,216 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,216 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3a70410b] 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:48,217 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(8d25230){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(8d25230){key=key-to-change0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:48,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:48,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=initial-value} in container 09:58:48,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,221 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89324 to Test-NodeA-7051 09:58:48,221 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #80, conn_id=0) 09:58:48,222 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89324, rsp_expected=true, UNICAST3: DATA, seqno=80, TP: [cluster_name=ISPN] 09:58:48,222 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,222 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,222 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36412 09:58:48,222 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89324, rsp_expected=true, UNICAST3: DATA, seqno=80, TP: [cluster_name=ISPN] 09:58:48,222 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #80, conn_id=0) 09:58:48,223 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#80 09:58:48,224 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,224 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,224 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(ed54250){key=key-to-change0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,224 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:48,224 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,224 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,224 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:48,226 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=initial-value} in container 09:58:48,226 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,226 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:36412 09:58:48,227 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36412. 09:58:48,227 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36412}. ACQUIRED => RELEASED 09:58:48,227 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36412}? true 09:58:48,227 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36412} 09:58:48,228 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36412}, null) => true 09:58:48,228 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,228 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@488e280f] 09:58:48,228 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,229 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:48,229 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change0 for read. Entry=ImmortalCacheEntry{key=key-to-change0, value=initial-value} 09:58:48,230 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:48,230 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:48,230 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6d710300] 09:58:48,230 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,230 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:48,230 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change0 for read. Entry=ImmortalCacheEntry{key=key-to-change0, value=initial-value} 09:58:48,230 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:48,230 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:48,230 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_close_iter_invoked * 1 09:58:48,230 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:48,248 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 176f9095-0a41-463a-b873-3070305bf243 09:58:48,248 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@42e1003c[Not completed] to remote execution at node Test-NodeB-10318 09:58:48,249 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60ee6c6] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,249 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60ee6c6], mode=SYNCHRONOUS, timeout=15000 09:58:48,249 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60ee6c6] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,249 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89331] on Test-NodeB-10318 09:58:48,250 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #79, conn_id=1) 09:58:48,250 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89331, rsp_expected=true, UNICAST3: DATA, seqno=79, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,251 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@7571846c[Not completed] to remote execution at node Test-NodeC-52778 09:58:48,250 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,251 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:48,251 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60ee6c6] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,251 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89331, rsp_expected=true, UNICAST3: DATA, seqno=79, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,251 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #79, conn_id=1) 09:58:48,251 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60ee6c6], mode=SYNCHRONOUS, timeout=15000 09:58:48,252 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60ee6c6] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,252 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#79 09:58:48,253 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89331 09:58:48,253 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7181a64a] [sender=Test-NodeA-7051] 09:58:48,253 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:48,253 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7181a64a] 09:58:48,253 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,253 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89333] on Test-NodeC-52778 09:58:48,253 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 176f9095-0a41-463a-b873-3070305bf243 09:58:48,253 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #135, conn_id=2) 09:58:48,254 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89333, rsp_expected=true, UNICAST3: DATA, seqno=135, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,254 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@7181a64a] 09:58:48,254 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89331 to Test-NodeA-7051 09:58:48,254 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,255 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #81, conn_id=0) 09:58:48,256 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89331, rsp_expected=true, UNICAST3: DATA, seqno=81, TP: [cluster_name=ISPN] 09:58:48,255 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:48,259 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89333, rsp_expected=true, UNICAST3: DATA, seqno=135, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,259 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #135, conn_id=2) 09:58:48,259 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#135 09:58:48,259 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89333 09:58:48,259 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@37d1af6a] [sender=Test-NodeA-7051] 09:58:48,259 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:48,259 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,259 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@37d1af6a] 09:58:48,260 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 176f9095-0a41-463a-b873-3070305bf243 09:58:48,260 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@37d1af6a] 09:58:48,260 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89333 to Test-NodeA-7051 09:58:48,256 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,264 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,264 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89331, rsp_expected=true, UNICAST3: DATA, seqno=81, TP: [cluster_name=ISPN] 09:58:48,264 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #81, conn_id=0) 09:58:48,264 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#81 09:58:48,260 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #138, conn_id=0) 09:58:48,266 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89333, rsp_expected=true, UNICAST3: DATA, seqno=138, TP: [cluster_name=ISPN] 09:58:48,266 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,266 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,266 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89333, rsp_expected=true, UNICAST3: DATA, seqno=138, TP: [cluster_name=ISPN] 09:58:48,266 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #138, conn_id=0) 09:58:48,266 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#138 09:58:48,266 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,266 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60ee6c6] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,269 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,270 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@60ee6c6] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,271 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 176f9095-0a41-463a-b873-3070305bf243 requests initial state for cache 09:58:48,271 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@668f6961] 09:58:48,271 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:48,275 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:48,275 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70517 09:58:48,278 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70517 excluding keys [] 09:58:48,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:48,281 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:48,282 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,283 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89339] on Test-NodeB-10318 09:58:48,283 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #80, conn_id=1) 09:58:48,283 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89339, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,283 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,284 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:48,285 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89339, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,285 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #80, conn_id=1) 09:58:48,285 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#80 09:58:48,286 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89339 09:58:48,286 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:48,286 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,287 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:48,287 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,288 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70517 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:48,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@6d334581] 09:58:48,290 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:48,291 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70517 09:58:48,292 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70517 09:58:48,292 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70517 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70517 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70517 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89343] on Test-NodeA-7051 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #82, conn_id=0) 09:58:48,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89343, rsp_expected=true, UNICAST3: DATA, seqno=82, TP: [cluster_name=ISPN] 09:58:48,293 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (224 bytes (1120.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,293 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (227 bytes) 09:58:48,294 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=150 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89343, rsp_expected=true, UNICAST3: DATA, seqno=82, TP: [cluster_name=ISPN] 09:58:48,294 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #82, conn_id=0) 09:58:48,295 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#82 09:58:48,295 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89343 09:58:48,295 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:48,297 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:48,297 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,297 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:48,310 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70517 with [] suspected segments. 09:58:48,310 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:48,310 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:48,311 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:48,311 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89343 to Test-NodeB-10318 09:58:48,311 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #81, conn_id=1) 09:58:48,311 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89343, rsp_expected=true, UNICAST3: DATA, seqno=81, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,317 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,317 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:48,318 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89343, rsp_expected=true, UNICAST3: DATA, seqno=81, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,318 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #81, conn_id=1) 09:58:48,318 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#81 09:58:48,318 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:48,318 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:48,318 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:48,318 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89339 to Test-NodeA-7051 09:58:48,318 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #83, conn_id=0) 09:58:48,318 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89339, rsp_expected=true, UNICAST3: DATA, seqno=83, TP: [cluster_name=ISPN] 09:58:48,318 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,321 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:48,327 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89339, rsp_expected=true, UNICAST3: DATA, seqno=83, TP: [cluster_name=ISPN] 09:58:48,327 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #83, conn_id=0) 09:58:48,327 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#83 09:58:48,327 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:48,328 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,333 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70517 excluding keys [] 09:58:48,334 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,334 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:48,334 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:48,334 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,334 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89350] on Test-NodeC-52778 09:58:48,334 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #136, conn_id=2) 09:58:48,334 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89350, rsp_expected=true, UNICAST3: DATA, seqno=136, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,334 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,335 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:48,335 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89350, rsp_expected=true, UNICAST3: DATA, seqno=136, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,335 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #136, conn_id=2) 09:58:48,335 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#136 09:58:48,335 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89350 09:58:48,335 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:48,335 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,335 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:48,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70517 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:48,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@1598b6f8] 09:58:48,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:48,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70517 09:58:48,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70517 09:58:48,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70517 09:58:48,335 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:48,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70517 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:48,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70517 09:58:48,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:48,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:48,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89351] on Test-NodeA-7051 09:58:48,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #139, conn_id=0) 09:58:48,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89351, rsp_expected=true, UNICAST3: DATA, seqno=139, TP: [cluster_name=ISPN] 09:58:48,336 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,336 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:48,336 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89351, rsp_expected=true, UNICAST3: DATA, seqno=139, TP: [cluster_name=ISPN] 09:58:48,336 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #139, conn_id=0) 09:58:48,336 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#139 09:58:48,336 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89351 09:58:48,336 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:48,336 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:48,336 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70517 with [] suspected segments. 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70517 as completed! 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89351 to Test-NodeC-52778 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #137, conn_id=2) 09:58:48,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89351, rsp_expected=true, UNICAST3: DATA, seqno=137, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,336 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,336 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:48,336 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89351, rsp_expected=true, UNICAST3: DATA, seqno=137, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,336 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #137, conn_id=2) 09:58:48,336 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#137 09:58:48,336 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:48,336 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:48,341 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:48,342 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89350 to Test-NodeA-7051 09:58:48,342 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #140, conn_id=0) 09:58:48,342 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89350, rsp_expected=true, UNICAST3: DATA, seqno=140, TP: [cluster_name=ISPN] 09:58:48,343 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,343 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:48,343 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89350, rsp_expected=true, UNICAST3: DATA, seqno=140, TP: [cluster_name=ISPN] 09:58:48,343 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #140, conn_id=0) 09:58:48,344 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#140 09:58:48,344 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:48,344 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,345 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:48,345 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 2 for id Test-NodeA-70517 09:58:48,345 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:48,346 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 2 09:58:48,347 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70517 09:58:48,347 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70517 being completed: true 09:58:48,347 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70517 09:58:48,347 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,350 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:48,350 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:48,351 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:48,352 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:48,353 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:48,353 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:48,353 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:48,353 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:48,354 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:48,354 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:48,355 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:48,355 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:48,355 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:48,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:48,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:48,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:48,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:48,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:48,363 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:48,363 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:48,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:48,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:48,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:48,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:48,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:48,365 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:48,365 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:48,365 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:48,366 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:48,366 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:48,366 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:48,367 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:48,367 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:48,368 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:48,368 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:48,369 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:48,369 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:48,369 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:48,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:48,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:48,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:48,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:48,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:48,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:48,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:48,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:48,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:48,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:48,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:48,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:48,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:48,376 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:48,376 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:48,376 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:48,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:48,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:48,378 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:48,378 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:48,379 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:48,379 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:48,379 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:48,379 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:48,379 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:48,379 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:48,380 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:48,380 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:48,382 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:48,382 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:48,383 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:48,383 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:48,383 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:48,390 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:48,391 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:48,392 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:48,392 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:48,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:48,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:48,396 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:48,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:48,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:48,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:48,400 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:48,400 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:48,400 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:48,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:48,401 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,402 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,402 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,403 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,403 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,403 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,403 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,403 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:48,403 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:48,404 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:48,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:48,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:48,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:48,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:48,405 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,405 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change0, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:48,405 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:48,405 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_close_iter_invoked * 1 (available = 1, total = 1) 09:58:48,405 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_close_iter_released * 1 09:58:48,405 TRACE (testng-Test:[]) [CheckPoint] Received event pre_close_iter_invoked * 1 (available = 0, total = 1) 09:58:48,406 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@232c4029] 09:58:48,407 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,407 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:58:48,408 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:36449. timeout=10000 (MILLISECONDS) 09:58:48,411 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36449. Timeout=10000 (MILLISECONDS) 09:58:48,413 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36449} 09:58:48,413 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36449}. Current=null 09:58:48,413 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36449}) => true 09:58:48,414 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36449}. WAITING => ACQUIRED 09:58:48,415 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36449} successfully acquired the lock. 09:58:48,415 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:48,415 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:48,415 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,417 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:48,418 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:48,418 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5184beeb){key=key-to-change0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:48,419 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,421 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,422 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:48,422 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,423 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,424 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,425 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89379] on Test-NodeB-10318 09:58:48,426 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #82, conn_id=1) 09:58:48,426 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89379, rsp_expected=true, UNICAST3: DATA, seqno=82, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,426 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,427 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:48,428 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89379, rsp_expected=true, UNICAST3: DATA, seqno=82, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,435 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #82, conn_id=1) 09:58:48,435 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#82 09:58:48,435 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89379 09:58:48,435 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,435 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,435 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,435 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,436 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,436 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7e190847] 09:58:48,436 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,436 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:58:48,436 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,439 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:48,439 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,439 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:48,439 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:48,439 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5f9f968a){key=key-to-change0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:48,439 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5f9f968a){key=key-to-change0, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change0, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=changed-value} in container 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89379 to Test-NodeA-7051 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #84, conn_id=0) 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89379, rsp_expected=true, UNICAST3: DATA, seqno=84, TP: [cluster_name=ISPN] 09:58:48,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36449 09:58:48,440 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,440 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:58:48,441 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89379, rsp_expected=true, UNICAST3: DATA, seqno=84, TP: [cluster_name=ISPN] 09:58:48,441 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #84, conn_id=0) 09:58:48,441 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#84 09:58:48,441 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:48,441 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:58:48,441 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5184beeb){key=key-to-change0, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,441 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:48,441 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,441 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,441 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change0, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:48,441 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=changed-value} in container 09:58:48,441 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_MODIFIED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change0, value=changed-value, oldValue=initial-value, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:48,441 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:48,443 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:36449 09:58:48,444 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36449. 09:58:48,444 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36449}. ACQUIRED => RELEASED 09:58:48,444 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36449}? true 09:58:48,445 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36449} 09:58:48,445 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36449}, null) => true 09:58:48,445 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,445 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_close_iter_released * 999999999 (available = 999999999, total = 999999999) 09:58:48,446 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_close_iter_released * 1 (available = 999999998, total = 999999999) 09:58:48,446 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 176f9095-0a41-463a-b873-3070305bf243 initial state for cache completed 09:58:48,447 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:48,459 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:48,459 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:48,460 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@768d5d2a[Not completed] to self 09:58:48,460 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@29e89680[Not completed] to remote execution at node Test-NodeB-10318 09:58:48,460 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@692a4db2] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,460 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@692a4db2], mode=SYNCHRONOUS, timeout=15000 09:58:48,460 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@692a4db2] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,460 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89383] on Test-NodeB-10318 09:58:48,460 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #83, conn_id=1) 09:58:48,461 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89383, rsp_expected=true, UNICAST3: DATA, seqno=83, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,462 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@1e3b7e9a[Not completed] to remote execution at node Test-NodeC-52778 09:58:48,462 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@692a4db2] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,462 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@692a4db2], mode=SYNCHRONOUS, timeout=15000 09:58:48,462 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@692a4db2] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,462 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89385] on Test-NodeC-52778 09:58:48,462 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #138, conn_id=2) 09:58:48,462 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89385, rsp_expected=true, UNICAST3: DATA, seqno=138, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,462 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (424 bytes (2120.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:48,464 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:48,465 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89385, rsp_expected=true, UNICAST3: DATA, seqno=138, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,465 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #138, conn_id=2) 09:58:48,464 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:48,469 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89383, rsp_expected=true, UNICAST3: DATA, seqno=83, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,469 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #83, conn_id=1) 09:58:48,469 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#83 09:58:48,469 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89383 09:58:48,469 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2ed20f5d] [sender=Test-NodeA-7051] 09:58:48,469 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:48,469 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2ed20f5d] 09:58:48,470 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 176f9095-0a41-463a-b873-3070305bf243 09:58:48,470 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2ed20f5d] 09:58:48,470 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89383 to Test-NodeA-7051 09:58:48,470 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #85, conn_id=0) 09:58:48,470 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89383, rsp_expected=true, UNICAST3: DATA, seqno=85, TP: [cluster_name=ISPN] 09:58:48,470 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,470 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,470 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89383, rsp_expected=true, UNICAST3: DATA, seqno=85, TP: [cluster_name=ISPN] 09:58:48,473 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #85, conn_id=0) 09:58:48,473 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#85 09:58:48,473 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,473 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@692a4db2] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,474 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#138 09:58:48,475 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89385 09:58:48,476 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@65b4895] [sender=Test-NodeA-7051] 09:58:48,477 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:48,479 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@65b4895] 09:58:48,479 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,481 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 176f9095-0a41-463a-b873-3070305bf243 09:58:48,483 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@65b4895] 09:58:48,485 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89385 to Test-NodeA-7051 09:58:48,486 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #141, conn_id=0) 09:58:48,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89385, rsp_expected=true, UNICAST3: DATA, seqno=141, TP: [cluster_name=ISPN] 09:58:48,487 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,489 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,491 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89385, rsp_expected=true, UNICAST3: DATA, seqno=141, TP: [cluster_name=ISPN] 09:58:48,491 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #141, conn_id=0) 09:58:48,494 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#141 09:58:48,494 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,494 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@692a4db2] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,494 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndCompletedSegmentValueOwnerClustered 09:58:48,494 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:48,495 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:48,495 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:48,495 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:48,496 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:48,497 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:48,497 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:48,497 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:48,499 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:48,499 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:48,505 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:48,507 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:48,508 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:48,509 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:48,510 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered 09:58:48,510 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2add43a4] 09:58:48,510 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,511 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:48,511 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:48,513 TRACE (Timer-3,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:48,513 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:48,513 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,513 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:48,514 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,514 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:48,514 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:48,514 TRACE (INT-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeC-52778: mine: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:48,514 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,515 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:48,515 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,516 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,516 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,517 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89396] on Test-NodeB-10318 09:58:48,517 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #84, conn_id=1) 09:58:48,517 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89396, rsp_expected=true, UNICAST3: DATA, seqno=84, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,517 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,517 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:48,561 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #83) 09:58:48,561 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=83, conn_id=1, ts=45, TP: [cluster_name=ISPN] 09:58:48,518 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89396, rsp_expected=true, UNICAST3: DATA, seqno=84, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,562 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #84, conn_id=1) 09:58:48,562 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#84 09:58:48,562 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89396 09:58:48,563 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,563 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,561 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,564 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:48,561 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #34) 09:58:48,564 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=34, conn_id=1, ts=46, TP: [cluster_name=ISPN] 09:58:48,565 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,565 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:48,565 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=34, conn_id=1, ts=46, TP: [cluster_name=ISPN] 09:58:48,565 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #34, conn-id=1, ts=46) 09:58:48,567 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=83, conn_id=1, ts=45, TP: [cluster_name=ISPN] 09:58:48,567 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #83, conn-id=1, ts=45) 09:58:48,563 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:36459. timeout=10000 (MILLISECONDS) 09:58:48,573 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36459. Timeout=10000 (MILLISECONDS) 09:58:48,573 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36459} 09:58:48,573 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36459}. Current=null 09:58:48,573 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36459}) => true 09:58:48,573 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36459}. WAITING => ACQUIRED 09:58:48,573 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36459} successfully acquired the lock. 09:58:48,573 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,574 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #34) 09:58:48,577 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=34, conn_id=1, ts=45, TP: [cluster_name=ISPN] 09:58:48,577 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,577 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #138) 09:58:48,577 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=138, conn_id=2, ts=46, TP: [cluster_name=ISPN] 09:58:48,576 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,575 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #85) 09:58:48,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6c36f5c2] 09:58:48,577 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:48,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,579 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=34, conn_id=1, ts=45, TP: [cluster_name=ISPN] 09:58:48,579 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #34, conn-id=1, ts=45) 09:58:48,578 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=85, ts=52, TP: [cluster_name=ISPN] 09:58:48,579 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #141) 09:58:48,579 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,579 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:48,579 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:36459. timeout=10000 (MILLISECONDS) 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36459. Timeout=10000 (MILLISECONDS) 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36459} 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4387349f){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,579 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,581 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:48,579 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=85, ts=52, TP: [cluster_name=ISPN] 09:58:48,582 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=141, ts=53, TP: [cluster_name=ISPN] 09:58:48,582 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #85, conn-id=0, ts=52) 09:58:48,582 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,582 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=138, conn_id=2, ts=46, TP: [cluster_name=ISPN] 09:58:48,582 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #138, conn-id=2, ts=46) 09:58:48,581 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89398] on Test-NodeC-52778 09:58:48,582 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:48,583 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=141, ts=53, TP: [cluster_name=ISPN] 09:58:48,583 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #141, conn-id=0, ts=53) 09:58:48,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #35, conn_id=1) 09:58:48,584 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89398, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,588 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,594 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,596 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89398, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,603 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #35, conn_id=1) 09:58:48,603 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#35 09:58:48,605 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89398 09:58:48,605 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:48,606 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,606 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,607 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,608 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@599b4c58] 09:58:48,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:48,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:48,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,613 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,620 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:48,620 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(43da7a44){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,625 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,626 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,626 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(43da7a44){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,626 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:48,627 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,627 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,627 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:48,627 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:48,627 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,629 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,629 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89398 to Test-NodeB-10318 09:58:48,629 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #35, conn_id=1) 09:58:48,629 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89398, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,629 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36459 09:58:48,629 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,629 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:48,630 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89398, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,630 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #35, conn_id=1) 09:58:48,630 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#35 09:58:48,630 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,630 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,630 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4387349f){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,631 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:48,636 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,637 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,641 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:48,641 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:48,641 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,647 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:36459 09:58:48,647 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36459. 09:58:48,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36459}. ACQUIRED => RELEASED 09:58:48,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36459}? true 09:58:48,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36459} 09:58:48,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36459}, null) => true 09:58:48,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,656 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89396 to Test-NodeA-7051 09:58:48,661 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #86, conn_id=0) 09:58:48,661 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89396, rsp_expected=true, UNICAST3: DATA, seqno=86, TP: [cluster_name=ISPN] 09:58:48,661 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,661 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,661 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:36459 09:58:48,664 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89396, rsp_expected=true, UNICAST3: DATA, seqno=86, TP: [cluster_name=ISPN] 09:58:48,665 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #86, conn_id=0) 09:58:48,665 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#86 09:58:48,665 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,665 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,665 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,665 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3993ba16] 09:58:48,666 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,666 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:48,667 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:48,667 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:48,667 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,676 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,681 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:48,681 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,681 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,683 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,683 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89421] on Test-NodeC-52778 09:58:48,684 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #139, conn_id=2) 09:58:48,684 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89421, rsp_expected=true, UNICAST3: DATA, seqno=139, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,684 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,684 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89421, rsp_expected=true, UNICAST3: DATA, seqno=139, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #139, conn_id=2) 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#139 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89421 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36474. timeout=10000 (MILLISECONDS) 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36474. Timeout=10000 (MILLISECONDS) 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36474} 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36474}. Current=null 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36474}) => true 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36474}. WAITING => ACQUIRED 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36474} successfully acquired the lock. 09:58:48,684 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@75367a6a] 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36474. timeout=10000 (MILLISECONDS) 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36474. Timeout=10000 (MILLISECONDS) 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36474} 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,684 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1d931672){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89422] on Test-NodeA-7051 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #142, conn_id=0) 09:58:48,685 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89422, rsp_expected=true, UNICAST3: DATA, seqno=142, TP: [cluster_name=ISPN] 09:58:48,685 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,689 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:48,692 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89422, rsp_expected=true, UNICAST3: DATA, seqno=142, TP: [cluster_name=ISPN] 09:58:48,692 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #142, conn_id=0) 09:58:48,692 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#142 09:58:48,693 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89422 09:58:48,695 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:48,695 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,695 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,696 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,696 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6447512d] 09:58:48,695 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,696 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,696 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:48,696 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,697 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:48,698 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,698 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,699 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:48,699 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6370e27){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,700 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,702 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,702 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6370e27){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,703 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:48,703 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,703 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,704 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:48,704 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:48,705 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,707 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,707 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89422 to Test-NodeC-52778 09:58:48,707 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #140, conn_id=2) 09:58:48,707 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89422, rsp_expected=true, UNICAST3: DATA, seqno=140, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,707 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36474 09:58:48,707 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,707 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:48,707 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89422, rsp_expected=true, UNICAST3: DATA, seqno=140, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,707 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #140, conn_id=2) 09:58:48,707 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#140 09:58:48,707 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,707 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:48,707 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1d931672){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,707 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:48,707 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,707 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,707 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:48,707 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:48,709 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,709 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36474 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36474. 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36474}. ACQUIRED => RELEASED 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36474}? true 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36474} 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36474}, null) => true 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89421 to Test-NodeA-7051 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #143, conn_id=0) 09:58:48,710 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89421, rsp_expected=true, UNICAST3: DATA, seqno=143, TP: [cluster_name=ISPN] 09:58:48,711 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36474 09:58:48,711 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,712 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,712 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89421, rsp_expected=true, UNICAST3: DATA, seqno=143, TP: [cluster_name=ISPN] 09:58:48,712 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #143, conn_id=0) 09:58:48,712 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#143 09:58:48,712 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,712 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,713 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,713 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@66f9ded6] 09:58:48,714 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,718 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:48,718 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:48,718 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:48,718 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,718 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,718 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:48,718 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,719 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,719 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,720 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89432] on Test-NodeC-52778 09:58:48,720 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #141, conn_id=2) 09:58:48,720 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89432, rsp_expected=true, UNICAST3: DATA, seqno=141, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,720 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,720 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,730 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89432, rsp_expected=true, UNICAST3: DATA, seqno=141, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,730 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #141, conn_id=2) 09:58:48,732 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#141 09:58:48,732 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89432 09:58:48,733 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,733 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,733 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36483. timeout=10000 (MILLISECONDS) 09:58:48,733 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36483. Timeout=10000 (MILLISECONDS) 09:58:48,733 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36483} 09:58:48,734 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36483}. Current=null 09:58:48,734 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36483}) => true 09:58:48,734 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36483}. WAITING => ACQUIRED 09:58:48,734 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36483} successfully acquired the lock. 09:58:48,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1f33158a] 09:58:48,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:48,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36483. timeout=10000 (MILLISECONDS) 09:58:48,734 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36483. Timeout=10000 (MILLISECONDS) 09:58:48,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36483} 09:58:48,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,739 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:48,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,747 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:48,747 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(40c41992){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,747 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,748 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,748 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,748 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,748 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,748 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89438] on Test-NodeB-10318 09:58:48,748 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #36, conn_id=1) 09:58:48,748 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89438, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,748 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,753 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:48,754 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89438, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,755 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #36, conn_id=1) 09:58:48,755 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#36 09:58:48,755 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89438 09:58:48,755 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:48,755 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,755 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,755 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,755 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,760 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4650927a] 09:58:48,761 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,762 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:48,763 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,763 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:48,763 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,772 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,777 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2bae31b5){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2bae31b5){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89438 to Test-NodeC-52778 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #36, conn_id=1) 09:58:48,779 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89438, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,780 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36483 09:58:48,780 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,780 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:48,781 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89438, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,781 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #36, conn_id=1) 09:58:48,783 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#36 09:58:48,783 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,783 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,783 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(40c41992){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,784 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:48,789 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,790 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,790 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:48,790 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:48,790 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,790 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36483 09:58:48,790 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36483. 09:58:48,795 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36483}. ACQUIRED => RELEASED 09:58:48,796 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36483}? true 09:58:48,796 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36483} 09:58:48,796 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36483}, null) => true 09:58:48,797 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,797 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89432 to Test-NodeA-7051 09:58:48,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #144, conn_id=0) 09:58:48,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89432, rsp_expected=true, UNICAST3: DATA, seqno=144, TP: [cluster_name=ISPN] 09:58:48,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36483 09:58:48,801 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,801 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,805 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89432, rsp_expected=true, UNICAST3: DATA, seqno=144, TP: [cluster_name=ISPN] 09:58:48,805 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #144, conn_id=0) 09:58:48,805 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#144 09:58:48,805 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,805 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,805 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,805 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@596cc694] 09:58:48,805 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,805 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:48,805 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:48,810 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:48,810 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,815 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,818 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:48,819 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,819 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,819 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,820 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89456] on Test-NodeC-52778 09:58:48,821 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #142, conn_id=2) 09:58:48,821 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89456, rsp_expected=true, UNICAST3: DATA, seqno=142, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,821 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,821 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,821 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89456, rsp_expected=true, UNICAST3: DATA, seqno=142, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,821 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #142, conn_id=2) 09:58:48,821 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#142 09:58:48,821 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89456 09:58:48,821 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,821 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,826 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36498. timeout=10000 (MILLISECONDS) 09:58:48,826 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36498. Timeout=10000 (MILLISECONDS) 09:58:48,828 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36498} 09:58:48,828 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36498}. Current=null 09:58:48,828 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36498}) => true 09:58:48,828 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36498}. WAITING => ACQUIRED 09:58:48,831 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36498} successfully acquired the lock. 09:58:48,832 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,832 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,832 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,832 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@221d2c3d] 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36498. timeout=10000 (MILLISECONDS) 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36498. Timeout=10000 (MILLISECONDS) 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36498} 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6d64723c){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89458] on Test-NodeB-10318 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #37, conn_id=1) 09:58:48,839 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89458, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,839 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,839 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:48,844 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89458, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,844 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #37, conn_id=1) 09:58:48,844 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#37 09:58:48,844 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89458 09:58:48,844 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:48,845 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,845 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7339bb9c] 09:58:48,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:48,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:48,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,849 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,853 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(196acf97){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(196acf97){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,856 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89458 to Test-NodeC-52778 09:58:48,856 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #37, conn_id=1) 09:58:48,856 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89458, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,856 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36498 09:58:48,857 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,857 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:48,857 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89458, rsp_expected=true, UNICAST3: DATA, seqno=37, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,857 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #37, conn_id=1) 09:58:48,857 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#37 09:58:48,857 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,857 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,857 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6d64723c){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,857 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:48,858 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,858 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,858 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:48,858 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:48,863 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,863 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36498 09:58:48,863 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36498. 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36498}. ACQUIRED => RELEASED 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36498}? true 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36498} 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36498}, null) => true 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89456 to Test-NodeA-7051 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #145, conn_id=0) 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89456, rsp_expected=true, UNICAST3: DATA, seqno=145, TP: [cluster_name=ISPN] 09:58:48,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36498 09:58:48,873 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,873 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,873 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89456, rsp_expected=true, UNICAST3: DATA, seqno=145, TP: [cluster_name=ISPN] 09:58:48,873 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #145, conn_id=0) 09:58:48,873 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#145 09:58:48,873 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,873 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,873 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,873 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@50248c45] 09:58:48,873 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,873 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:48,873 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:48,873 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:48,873 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,873 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,873 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:48,873 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,874 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,874 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,874 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89465] on Test-NodeC-52778 09:58:48,874 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #143, conn_id=2) 09:58:48,874 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89465, rsp_expected=true, UNICAST3: DATA, seqno=143, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,874 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,874 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89465, rsp_expected=true, UNICAST3: DATA, seqno=143, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #143, conn_id=2) 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#143 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89465 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36506. timeout=10000 (MILLISECONDS) 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36506. Timeout=10000 (MILLISECONDS) 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36506} 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36506}. Current=null 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36506}) => true 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36506}. WAITING => ACQUIRED 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36506} successfully acquired the lock. 09:58:48,875 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,875 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,875 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,879 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2148fe7] 09:58:48,879 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,879 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36506. timeout=10000 (MILLISECONDS) 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36506. Timeout=10000 (MILLISECONDS) 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36506} 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7327a220){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89469] on Test-NodeA-7051 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #146, conn_id=0) 09:58:48,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89469, rsp_expected=true, UNICAST3: DATA, seqno=146, TP: [cluster_name=ISPN] 09:58:48,880 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,883 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:48,883 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89469, rsp_expected=true, UNICAST3: DATA, seqno=146, TP: [cluster_name=ISPN] 09:58:48,883 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #146, conn_id=0) 09:58:48,883 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#146 09:58:48,883 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89469 09:58:48,883 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:48,883 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,883 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,883 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,883 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,883 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1717ba3b] 09:58:48,883 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,883 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:48,883 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,883 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:48,884 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,884 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,884 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:48,884 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(656392d2){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,884 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(656392d2){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,885 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:48,889 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,889 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,889 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:48,889 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:48,889 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,890 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,901 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89469 to Test-NodeC-52778 09:58:48,901 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #144, conn_id=2) 09:58:48,901 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89469, rsp_expected=true, UNICAST3: DATA, seqno=144, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,901 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36506 09:58:48,901 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,902 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:48,902 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89469, rsp_expected=true, UNICAST3: DATA, seqno=144, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,902 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #144, conn_id=2) 09:58:48,902 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#144 09:58:48,902 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,902 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7327a220){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36506 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36506. 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36506}. ACQUIRED => RELEASED 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36506}? true 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36506} 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36506}, null) => true 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89465 to Test-NodeA-7051 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #147, conn_id=0) 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89465, rsp_expected=true, UNICAST3: DATA, seqno=147, TP: [cluster_name=ISPN] 09:58:48,902 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36506 09:58:48,902 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,902 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,903 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89465, rsp_expected=true, UNICAST3: DATA, seqno=147, TP: [cluster_name=ISPN] 09:58:48,903 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #147, conn_id=0) 09:58:48,903 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#147 09:58:48,903 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,903 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,903 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,903 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6277e2] 09:58:48,903 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,903 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:48,903 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:36511. timeout=10000 (MILLISECONDS) 09:58:48,903 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36511. Timeout=10000 (MILLISECONDS) 09:58:48,903 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36511} 09:58:48,903 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36511}. Current=null 09:58:48,903 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36511}) => true 09:58:48,903 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36511}. WAITING => ACQUIRED 09:58:48,903 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36511} successfully acquired the lock. 09:58:48,903 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:48,903 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:48,903 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,903 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,903 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:48,903 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(de2c30f){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,903 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,903 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,903 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:48,903 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,903 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,903 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:48,903 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89473] on Test-NodeB-10318 09:58:48,903 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #85, conn_id=1) 09:58:48,903 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89473, rsp_expected=true, UNICAST3: DATA, seqno=85, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,903 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:48,903 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:48,904 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89473, rsp_expected=true, UNICAST3: DATA, seqno=85, conn_id=1, TP: [cluster_name=ISPN] 09:58:48,904 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #85, conn_id=1) 09:58:48,904 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#85 09:58:48,904 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89473 09:58:48,904 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,904 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,904 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5beb4d82] 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(112fcd3){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(112fcd3){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89473 to Test-NodeA-7051 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #87, conn_id=0) 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89473, rsp_expected=true, UNICAST3: DATA, seqno=87, TP: [cluster_name=ISPN] 09:58:48,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36511 09:58:48,904 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,904 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,905 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89473, rsp_expected=true, UNICAST3: DATA, seqno=87, TP: [cluster_name=ISPN] 09:58:48,905 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #87, conn_id=0) 09:58:48,905 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#87 09:58:48,905 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,905 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:48,905 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(de2c30f){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,905 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:48,905 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,909 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,909 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:48,909 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:48,909 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,909 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:36511 09:58:48,909 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36511. 09:58:48,909 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36511}. ACQUIRED => RELEASED 09:58:48,909 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36511}? true 09:58:48,909 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36511} 09:58:48,909 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36511}, null) => true 09:58:48,909 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,909 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@241cb62a] 09:58:48,909 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,909 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:48,909 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:48,909 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:48,909 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,909 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,909 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:48,909 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,909 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,909 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,909 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89474] on Test-NodeC-52778 09:58:48,909 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #145, conn_id=2) 09:58:48,909 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89474, rsp_expected=true, UNICAST3: DATA, seqno=145, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,909 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,909 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:48,914 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89474, rsp_expected=true, UNICAST3: DATA, seqno=145, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,919 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #145, conn_id=2) 09:58:48,928 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#145 09:58:48,937 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89474 09:58:48,945 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:48,945 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,945 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36512. timeout=10000 (MILLISECONDS) 09:58:48,945 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36512. Timeout=10000 (MILLISECONDS) 09:58:48,945 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36512} 09:58:48,946 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36512}. Current=null 09:58:48,949 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36512}) => true 09:58:48,949 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36512}. WAITING => ACQUIRED 09:58:48,949 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36512} successfully acquired the lock. 09:58:48,949 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,949 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,950 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,954 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@33a4ff1c] 09:58:48,954 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,954 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:48,954 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36512. timeout=10000 (MILLISECONDS) 09:58:48,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36512. Timeout=10000 (MILLISECONDS) 09:58:48,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36512} 09:58:48,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:48,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:48,960 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,962 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,962 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:48,962 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4bfe7a63){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,962 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:48,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89487] on Test-NodeA-7051 09:58:48,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #148, conn_id=0) 09:58:48,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89487, rsp_expected=true, UNICAST3: DATA, seqno=148, TP: [cluster_name=ISPN] 09:58:48,973 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,973 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:48,973 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89487, rsp_expected=true, UNICAST3: DATA, seqno=148, TP: [cluster_name=ISPN] 09:58:48,973 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #148, conn_id=0) 09:58:48,973 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#148 09:58:48,973 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89487 09:58:48,973 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:48,973 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:48,973 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:48,973 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,973 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:48,973 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3b73696a] 09:58:48,973 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:48,973 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:48,973 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:48,973 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(58b0e15){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(58b0e15){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:48,974 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:48,976 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,980 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,980 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89487 to Test-NodeC-52778 09:58:48,980 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #146, conn_id=2) 09:58:48,980 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89487, rsp_expected=true, UNICAST3: DATA, seqno=146, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,989 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36512 09:58:48,990 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,990 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:48,990 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89487, rsp_expected=true, UNICAST3: DATA, seqno=146, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,990 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #146, conn_id=2) 09:58:48,990 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#146 09:58:48,990 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,990 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4bfe7a63){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36512 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36512. 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36512}. ACQUIRED => RELEASED 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36512}? true 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36512} 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36512}, null) => true 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89474 to Test-NodeA-7051 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #149, conn_id=0) 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89474, rsp_expected=true, UNICAST3: DATA, seqno=149, TP: [cluster_name=ISPN] 09:58:48,991 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36512 09:58:48,991 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:48,998 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:48,999 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89474, rsp_expected=true, UNICAST3: DATA, seqno=149, TP: [cluster_name=ISPN] 09:58:48,999 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #149, conn_id=0) 09:58:48,999 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#149 09:58:48,999 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:48,999 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:48,999 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:48,999 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5008a2ce] 09:58:48,999 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:48,999 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:48,999 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:48,999 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:48,999 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:48,999 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:48,999 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:48,999 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:48,999 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:48,999 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:48,999 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89491] on Test-NodeC-52778 09:58:48,999 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #147, conn_id=2) 09:58:48,999 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89491, rsp_expected=true, UNICAST3: DATA, seqno=147, conn_id=2, TP: [cluster_name=ISPN] 09:58:48,999 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:48,999 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:49,000 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89491, rsp_expected=true, UNICAST3: DATA, seqno=147, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,000 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #147, conn_id=2) 09:58:49,000 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#147 09:58:49,000 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89491 09:58:49,000 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:49,010 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,011 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36515. timeout=10000 (MILLISECONDS) 09:58:49,015 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36515. Timeout=10000 (MILLISECONDS) 09:58:49,020 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36515} 09:58:49,020 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36515}. Current=null 09:58:49,020 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36515}) => true 09:58:49,020 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36515}. WAITING => ACQUIRED 09:58:49,020 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36515} successfully acquired the lock. 09:58:49,020 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,020 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,020 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,020 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@74af90ec] 09:58:49,020 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,020 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:49,020 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36515. timeout=10000 (MILLISECONDS) 09:58:49,020 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36515. Timeout=10000 (MILLISECONDS) 09:58:49,020 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36515} 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1700b932){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:49,021 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89495] on Test-NodeA-7051 09:58:49,028 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #150, conn_id=0) 09:58:49,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89495, rsp_expected=true, UNICAST3: DATA, seqno=150, TP: [cluster_name=ISPN] 09:58:49,033 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,033 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:49,034 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89495, rsp_expected=true, UNICAST3: DATA, seqno=150, TP: [cluster_name=ISPN] 09:58:49,035 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #150, conn_id=0) 09:58:49,037 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#150 09:58:49,038 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89495 09:58:49,038 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:49,058 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,058 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,060 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,062 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,062 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2f67aafd] 09:58:49,065 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #85) 09:58:49,073 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,065 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=85, conn_id=1, ts=47, TP: [cluster_name=ISPN] 09:58:49,078 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,078 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #37) 09:58:49,079 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=37, conn_id=1, ts=47, TP: [cluster_name=ISPN] 09:58:49,079 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #147) 09:58:49,079 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=147, conn_id=2, ts=48, TP: [cluster_name=ISPN] 09:58:49,079 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:49,079 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:49,079 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:49,079 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=37, conn_id=1, ts=47, TP: [cluster_name=ISPN] 09:58:49,079 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #37, conn-id=1, ts=47) 09:58:49,079 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=147, conn_id=2, ts=48, TP: [cluster_name=ISPN] 09:58:49,079 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #147, conn-id=2, ts=48) 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(56eb58c1){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(56eb58c1){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89495 to Test-NodeC-52778 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #148, conn_id=2) 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89495, rsp_expected=true, UNICAST3: DATA, seqno=148, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,081 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36515 09:58:49,081 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,082 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:49,082 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89495, rsp_expected=true, UNICAST3: DATA, seqno=148, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,082 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #87) 09:58:49,078 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:49,083 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=85, conn_id=1, ts=47, TP: [cluster_name=ISPN] 09:58:49,078 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #37) 09:58:49,084 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=37, conn_id=1, ts=48, TP: [cluster_name=ISPN] 09:58:49,084 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #85, conn-id=1, ts=47) 09:58:49,084 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,082 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=87, ts=54, TP: [cluster_name=ISPN] 09:58:49,085 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #150) 09:58:49,085 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:49,082 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #148, conn_id=2) 09:58:49,085 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#148 09:58:49,086 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,085 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:49,085 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=150, ts=55, TP: [cluster_name=ISPN] 09:58:49,087 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=87, ts=54, TP: [cluster_name=ISPN] 09:58:49,089 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:49,087 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #87, conn-id=0, ts=54) 09:58:49,087 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,086 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:49,089 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:49,092 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=150, ts=55, TP: [cluster_name=ISPN] 09:58:49,092 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #150, conn-id=0, ts=55) 09:58:49,089 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=37, conn_id=1, ts=48, TP: [cluster_name=ISPN] 09:58:49,093 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #37, conn-id=1, ts=48) 09:58:49,089 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1700b932){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,113 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:49,113 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36515 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36515. 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36515}. ACQUIRED => RELEASED 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36515}? true 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36515} 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36515}, null) => true 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89491 to Test-NodeA-7051 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #151, conn_id=0) 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89491, rsp_expected=true, UNICAST3: DATA, seqno=151, TP: [cluster_name=ISPN] 09:58:49,117 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36515 09:58:49,117 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,132 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:49,132 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89491, rsp_expected=true, UNICAST3: DATA, seqno=151, TP: [cluster_name=ISPN] 09:58:49,137 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #151, conn_id=0) 09:58:49,155 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#151 09:58:49,155 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,155 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:49,155 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,155 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@419fc90b] 09:58:49,155 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:49,155 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:49,155 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:49,156 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:49,156 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,156 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,156 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:49,156 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,156 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,156 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:49,156 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89519] on Test-NodeB-10318 09:58:49,156 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #86, conn_id=1) 09:58:49,156 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89519, rsp_expected=true, UNICAST3: DATA, seqno=86, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,156 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:49,156 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:49,165 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89519, rsp_expected=true, UNICAST3: DATA, seqno=86, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,165 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #86, conn_id=1) 09:58:49,165 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#86 09:58:49,165 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89519 09:58:49,165 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36534. timeout=10000 (MILLISECONDS) 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36534. Timeout=10000 (MILLISECONDS) 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36534} 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36534}. Current=null 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36534}) => true 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36534}. WAITING => ACQUIRED 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36534} successfully acquired the lock. 09:58:49,166 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3f495236] 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36534. timeout=10000 (MILLISECONDS) 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36534. Timeout=10000 (MILLISECONDS) 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36534} 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7010343f){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89520] on Test-NodeC-52778 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #38, conn_id=1) 09:58:49,166 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89520, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,167 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,167 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:49,167 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89520, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,167 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #38, conn_id=1) 09:58:49,167 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#38 09:58:49,167 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89520 09:58:49,167 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:49,167 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,167 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4ecdf006] 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(436a5b4a){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,167 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(436a5b4a){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89520 to Test-NodeB-10318 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #38, conn_id=1) 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89520, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,168 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36534 09:58:49,168 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:49,168 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:49,171 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89520, rsp_expected=true, UNICAST3: DATA, seqno=38, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,190 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #38, conn_id=1) 09:58:49,190 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#38 09:58:49,198 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,199 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7010343f){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36534 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36534. 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36534}. ACQUIRED => RELEASED 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36534}? true 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36534} 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36534}, null) => true 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89519 to Test-NodeA-7051 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #88, conn_id=0) 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89519, rsp_expected=true, UNICAST3: DATA, seqno=88, TP: [cluster_name=ISPN] 09:58:49,199 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36534 09:58:49,200 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,200 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:49,200 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89519, rsp_expected=true, UNICAST3: DATA, seqno=88, TP: [cluster_name=ISPN] 09:58:49,200 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #88, conn_id=0) 09:58:49,200 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#88 09:58:49,200 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,200 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:49,200 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,200 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@36d0dc9] 09:58:49,200 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:49,200 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:49,200 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:49,200 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:49,200 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,200 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,200 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:49,212 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,212 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,213 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:49,213 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89526] on Test-NodeC-52778 09:58:49,213 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #149, conn_id=2) 09:58:49,213 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89526, rsp_expected=true, UNICAST3: DATA, seqno=149, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,213 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,213 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:49,215 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89526, rsp_expected=true, UNICAST3: DATA, seqno=149, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #149, conn_id=2) 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#149 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89526 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36537. timeout=10000 (MILLISECONDS) 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36537. Timeout=10000 (MILLISECONDS) 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36537} 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36537}. Current=null 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36537}) => true 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36537}. WAITING => ACQUIRED 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36537} successfully acquired the lock. 09:58:49,221 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3a5cb73] 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36537. timeout=10000 (MILLISECONDS) 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36537. Timeout=10000 (MILLISECONDS) 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36537} 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5993344a){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89528] on Test-NodeA-7051 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #152, conn_id=0) 09:58:49,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89528, rsp_expected=true, UNICAST3: DATA, seqno=152, TP: [cluster_name=ISPN] 09:58:49,222 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,222 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:49,229 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89528, rsp_expected=true, UNICAST3: DATA, seqno=152, TP: [cluster_name=ISPN] 09:58:49,229 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #152, conn_id=0) 09:58:49,229 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#152 09:58:49,229 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89528 09:58:49,229 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:49,233 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,233 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,233 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,233 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,233 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@76f3534f] 09:58:49,233 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,235 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:49,236 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:49,236 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:49,236 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,236 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:49,236 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:49,236 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2b550022){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:49,240 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,240 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,240 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2b550022){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,241 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:49,245 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,245 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,254 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:49,254 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:49,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,260 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,260 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89528 to Test-NodeC-52778 09:58:49,260 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #150, conn_id=2) 09:58:49,260 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89528, rsp_expected=true, UNICAST3: DATA, seqno=150, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,260 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36537 09:58:49,260 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,262 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:49,264 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89528, rsp_expected=true, UNICAST3: DATA, seqno=150, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,264 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #150, conn_id=2) 09:58:49,264 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#150 09:58:49,264 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,267 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:49,267 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5993344a){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,268 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:49,270 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,270 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,270 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:49,270 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:49,271 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,271 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36537 09:58:49,272 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36537. 09:58:49,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36537}. ACQUIRED => RELEASED 09:58:49,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36537}? true 09:58:49,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36537} 09:58:49,279 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36537}, null) => true 09:58:49,280 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:49,280 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,280 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89526 to Test-NodeA-7051 09:58:49,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #153, conn_id=0) 09:58:49,286 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89526, rsp_expected=true, UNICAST3: DATA, seqno=153, TP: [cluster_name=ISPN] 09:58:49,288 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36537 09:58:49,292 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,292 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:49,293 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89526, rsp_expected=true, UNICAST3: DATA, seqno=153, TP: [cluster_name=ISPN] 09:58:49,296 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #153, conn_id=0) 09:58:49,297 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#153 09:58:49,298 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,300 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:49,300 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,302 DEBUG (testng-Test:[]) [Test] Found key key-to-change-0 with primary owner != Test-NodeA-7051, segment 60 09:58:49,303 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3ecec5a9] 09:58:49,303 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:49,303 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:49,303 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:49,304 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? false 09:58:49,305 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,312 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,313 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:49,320 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,320 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,320 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:49,326 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89554] on Test-NodeC-52778 09:58:49,326 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #151, conn_id=2) 09:58:49,326 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89554, rsp_expected=true, UNICAST3: DATA, seqno=151, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,326 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (208 bytes (1040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,330 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (211 bytes) 09:58:49,332 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89554, rsp_expected=true, UNICAST3: DATA, seqno=151, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,332 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #151, conn_id=2) 09:58:49,332 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#151 09:58:49,332 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89554 09:58:49,332 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:36557. timeout=10000 (MILLISECONDS) 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36557. Timeout=10000 (MILLISECONDS) 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36557} 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36557}. Current=null 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36557}) => true 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36557}. WAITING => ACQUIRED 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36557} successfully acquired the lock. 09:58:49,333 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,333 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,333 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,333 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1863ac63] 09:58:49,333 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,333 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-to-change-0'? true 09:58:49,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:36557. timeout=10000 (MILLISECONDS) 09:58:49,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36557. Timeout=10000 (MILLISECONDS) 09:58:49,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36557} 09:58:49,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:49,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:49,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:49,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:49,339 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3170fbea){key=key-to-change-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:49,340 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,340 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,340 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,340 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,341 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:49,341 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89558] on Test-NodeA-7051 09:58:49,341 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #154, conn_id=0) 09:58:49,341 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89558, rsp_expected=true, UNICAST3: DATA, seqno=154, TP: [cluster_name=ISPN] 09:58:49,341 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (208 bytes (1040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,341 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (211 bytes) 09:58:49,342 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89558, rsp_expected=true, UNICAST3: DATA, seqno=154, TP: [cluster_name=ISPN] 09:58:49,342 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #154, conn_id=0) 09:58:49,342 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#154 09:58:49,342 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89558 09:58:49,352 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:49,352 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,352 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,352 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,352 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,352 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@397777f7] 09:58:49,353 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,411 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:49,411 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:49,411 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:49,416 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,416 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:49,421 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:49,421 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(35560d48){key=key-to-change-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:49,422 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,423 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,423 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(35560d48){key=key-to-change-0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,423 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:49,430 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,430 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,430 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:49,430 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-0, value=initial-value} in container 09:58:49,430 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,430 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,435 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89558 to Test-NodeC-52778 09:58:49,439 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #152, conn_id=2) 09:58:49,448 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89558, rsp_expected=true, UNICAST3: DATA, seqno=152, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,450 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,450 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:49,452 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89558, rsp_expected=true, UNICAST3: DATA, seqno=152, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,450 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36557 09:58:49,452 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #152, conn_id=2) 09:58:49,455 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#152 09:58:49,460 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,463 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:49,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3170fbea){key=key-to-change-0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:49,467 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,476 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,476 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:49,476 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-0, value=initial-value} in container 09:58:49,477 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,477 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:36557 09:58:49,477 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36557. 09:58:49,477 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36557}. ACQUIRED => RELEASED 09:58:49,477 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36557}? true 09:58:49,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36557} 09:58:49,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36557}, null) => true 09:58:49,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:49,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89554 to Test-NodeA-7051 09:58:49,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #155, conn_id=0) 09:58:49,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89554, rsp_expected=true, UNICAST3: DATA, seqno=155, TP: [cluster_name=ISPN] 09:58:49,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:36557 09:58:49,488 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,489 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:49,490 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89554, rsp_expected=true, UNICAST3: DATA, seqno=155, TP: [cluster_name=ISPN] 09:58:49,500 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #155, conn_id=0) 09:58:49,500 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#155 09:58:49,500 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,500 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:49,500 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:49,500 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@30022fef] 09:58:49,500 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,500 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:49,506 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-0 for read. Entry=ImmortalCacheEntry{key=key-to-change-0, value=initial-value} 09:58:49,507 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:49,507 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:49,507 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5965bf4f] 09:58:49,507 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,507 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:49,507 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-0 for read. Entry=ImmortalCacheEntry{key=key-to-change-0, value=initial-value} 09:58:49,507 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:49,507 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:49,507 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:58:49,508 TRACE (ForkThread-1,Test:[]) [Test] Started fork runnable.. 09:58:49,508 TRACE (ForkThread-1,Test:[]) [Test] Adding segment listener 046f9006-bcd1-44d1-b021-be6d06ddef21 : org.infinispan.notifications.cachelistener.DistributedQueueingSegmentListener@5b198ef8 09:58:49,508 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_complete_segment_invoked * 1 09:58:49,509 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 046f9006-bcd1-44d1-b021-be6d06ddef21 09:58:49,512 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5f910476[Not completed] to remote execution at node Test-NodeB-10318 09:58:49,515 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1a0ffb81] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,519 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1a0ffb81], mode=SYNCHRONOUS, timeout=15000 09:58:49,519 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1a0ffb81] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:49,519 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89576] on Test-NodeB-10318 09:58:49,519 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #87, conn_id=1) 09:58:49,519 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89576, rsp_expected=true, UNICAST3: DATA, seqno=87, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,519 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:49,519 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:49,519 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89576, rsp_expected=true, UNICAST3: DATA, seqno=87, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,519 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #87, conn_id=1) 09:58:49,519 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#87 09:58:49,519 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89576 09:58:49,527 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@16a9941e[Not completed] to remote execution at node Test-NodeC-52778 09:58:49,528 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@686a751f] [sender=Test-NodeA-7051] 09:58:49,528 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:49,528 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,528 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@686a751f] 09:58:49,527 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1a0ffb81] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,528 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 046f9006-bcd1-44d1-b021-be6d06ddef21 09:58:49,534 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1a0ffb81], mode=SYNCHRONOUS, timeout=15000 09:58:49,534 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@686a751f] 09:58:49,542 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89576 to Test-NodeA-7051 09:58:49,542 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1a0ffb81] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:49,542 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #89, conn_id=0) 09:58:49,546 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89576, rsp_expected=true, UNICAST3: DATA, seqno=89, TP: [cluster_name=ISPN] 09:58:49,546 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89581] on Test-NodeC-52778 09:58:49,546 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #153, conn_id=2) 09:58:49,546 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89581, rsp_expected=true, UNICAST3: DATA, seqno=153, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,546 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,561 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:49,546 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,561 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:49,561 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89576, rsp_expected=true, UNICAST3: DATA, seqno=89, TP: [cluster_name=ISPN] 09:58:49,561 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89581, rsp_expected=true, UNICAST3: DATA, seqno=153, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,564 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #153, conn_id=2) 09:58:49,564 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#153 09:58:49,564 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89581 09:58:49,564 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1b45b47a] [sender=Test-NodeA-7051] 09:58:49,564 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #89, conn_id=0) 09:58:49,565 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#89 09:58:49,573 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,574 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:49,574 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,574 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1b45b47a] 09:58:49,576 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 046f9006-bcd1-44d1-b021-be6d06ddef21 09:58:49,576 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1b45b47a] 09:58:49,576 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89581 to Test-NodeA-7051 09:58:49,576 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #156, conn_id=0) 09:58:49,576 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89581, rsp_expected=true, UNICAST3: DATA, seqno=156, TP: [cluster_name=ISPN] 09:58:49,576 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,576 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:49,573 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1a0ffb81] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:49,576 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89581, rsp_expected=true, UNICAST3: DATA, seqno=156, TP: [cluster_name=ISPN] 09:58:49,576 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #156, conn_id=0) 09:58:49,576 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#156 09:58:49,576 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,576 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1a0ffb81] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:49,576 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 046f9006-bcd1-44d1-b021-be6d06ddef21 requests initial state for cache 09:58:49,581 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@489165c4] 09:58:49,581 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:49,587 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:49,587 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70518 09:58:49,579 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #38) 09:58:49,588 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70518 excluding keys [] 09:58:49,587 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #89) 09:58:49,587 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #87) 09:58:49,589 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=89, ts=56, TP: [cluster_name=ISPN] 09:58:49,589 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #156) 09:58:49,589 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=156, ts=57, TP: [cluster_name=ISPN] 09:58:49,589 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:49,589 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:49,590 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=156, ts=57, TP: [cluster_name=ISPN] 09:58:49,590 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #156, conn-id=0, ts=57) 09:58:49,588 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,588 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=38, conn_id=1, ts=49, TP: [cluster_name=ISPN] 09:58:49,592 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #153) 09:58:49,592 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=153, conn_id=2, ts=50, TP: [cluster_name=ISPN] 09:58:49,593 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:49,593 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:49,593 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:49,593 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89586] on Test-NodeB-10318 09:58:49,593 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #88, conn_id=1) 09:58:49,593 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89586, rsp_expected=true, UNICAST3: DATA, seqno=88, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,590 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=87, conn_id=1, ts=49, TP: [cluster_name=ISPN] 09:58:49,595 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #38) 09:58:49,595 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=38, conn_id=1, ts=50, TP: [cluster_name=ISPN] 09:58:49,590 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:49,595 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,595 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=89, ts=56, TP: [cluster_name=ISPN] 09:58:49,595 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #89, conn-id=0, ts=56) 09:58:49,592 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:49,597 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:49,598 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:49,598 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=38, conn_id=1, ts=49, TP: [cluster_name=ISPN] 09:58:49,598 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=153, conn_id=2, ts=50, TP: [cluster_name=ISPN] 09:58:49,598 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #153, conn-id=2, ts=50) 09:58:49,595 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:49,600 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:49,600 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89586, rsp_expected=true, UNICAST3: DATA, seqno=88, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,601 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #88, conn_id=1) 09:58:49,601 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#88 09:58:49,601 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89586 09:58:49,601 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:49,601 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,601 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,601 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:49,601 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70518 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:49,598 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #38, conn-id=1, ts=49) 09:58:49,601 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@618d8f0c] 09:58:49,603 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:49,600 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:49,603 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70518 09:58:49,603 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,603 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:49,603 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=38, conn_id=1, ts=50, TP: [cluster_name=ISPN] 09:58:49,604 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #38, conn-id=1, ts=50) 09:58:49,604 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=87, conn_id=1, ts=49, TP: [cluster_name=ISPN] 09:58:49,609 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #87, conn-id=1, ts=49) 09:58:49,603 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70518 09:58:49,610 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70518 09:58:49,610 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:49,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70518 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:49,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70518 09:58:49,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:49,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:49,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89590] on Test-NodeA-7051 09:58:49,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #90, conn_id=0) 09:58:49,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89590, rsp_expected=true, UNICAST3: DATA, seqno=90, TP: [cluster_name=ISPN] 09:58:49,612 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (224 bytes (1120.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,613 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (227 bytes) 09:58:49,613 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=150 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89590, rsp_expected=true, UNICAST3: DATA, seqno=90, TP: [cluster_name=ISPN] 09:58:49,613 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #90, conn_id=0) 09:58:49,613 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#90 09:58:49,613 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89590 09:58:49,613 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:49,613 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:49,613 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,613 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:49,613 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70518 with [] suspected segments. 09:58:49,613 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:49,613 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:49,613 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 117, 247, 248, 252, 254, 127] 09:58:49,613 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:49,613 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89590 to Test-NodeB-10318 09:58:49,613 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #89, conn_id=1) 09:58:49,614 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89590, rsp_expected=true, UNICAST3: DATA, seqno=89, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,614 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:49,614 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:49,614 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89590, rsp_expected=true, UNICAST3: DATA, seqno=89, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,614 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #89, conn_id=1) 09:58:49,614 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#89 09:58:49,614 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:49,614 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:49,614 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:49,614 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89586 to Test-NodeA-7051 09:58:49,614 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #91, conn_id=0) 09:58:49,614 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89586, rsp_expected=true, UNICAST3: DATA, seqno=91, TP: [cluster_name=ISPN] 09:58:49,614 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,620 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:49,627 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89586, rsp_expected=true, UNICAST3: DATA, seqno=91, TP: [cluster_name=ISPN] 09:58:49,627 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #91, conn_id=0) 09:58:49,627 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#91 09:58:49,631 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:49,632 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:49,637 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70518 excluding keys [] 09:58:49,645 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,696 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,645 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:49,709 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-0 09:58:49,710 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:58:49,710 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:58:49,710 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:49,711 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:49,711 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89594] on Test-NodeC-52778 09:58:49,711 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:58:49,711 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:58:49,711 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #154, conn_id=2) 09:58:49,712 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89594, rsp_expected=true, UNICAST3: DATA, seqno=154, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,712 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,713 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:58:49,713 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:58:49,713 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:58:49,712 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:49,714 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89594, rsp_expected=true, UNICAST3: DATA, seqno=154, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,714 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #154, conn_id=2) 09:58:49,714 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#154 09:58:49,714 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89594 09:58:49,714 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:49,715 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,713 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:58:49,715 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:58:49,715 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:58:49,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:49,715 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,715 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:58:49,717 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:58:49,717 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:58:49,717 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:58:49,717 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:58:49,716 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70518 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:49,717 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:58:49,718 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:58:49,718 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:58:49,718 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@4e41b20f] 09:58:49,719 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:58:49,721 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:58:49,720 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:49,722 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:58:49,725 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:58:49,726 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70518 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70518 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70518 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70518 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70518 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89598] on Test-NodeA-7051 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #157, conn_id=0) 09:58:49,729 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89598, rsp_expected=true, UNICAST3: DATA, seqno=157, TP: [cluster_name=ISPN] 09:58:49,729 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (348 bytes (1740.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,729 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (351 bytes) 09:58:49,729 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=274 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89598, rsp_expected=true, UNICAST3: DATA, seqno=157, TP: [cluster_name=ISPN] 09:58:49,730 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #157, conn_id=0) 09:58:49,730 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#157 09:58:49,730 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89598 09:58:49,730 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:49,730 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:49,730 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70518 with [] suspected segments. 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 8 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [129, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 180, 181, 63, 67, 195, 69, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 103, 107, 108, 236, 239, 240, 113, 241, 245, 119, 120, 249, 122, 124, 253] 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70518 as completed! 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89598 to Test-NodeC-52778 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #155, conn_id=2) 09:58:49,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89598, rsp_expected=true, UNICAST3: DATA, seqno=155, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,730 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,730 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:49,730 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89598, rsp_expected=true, UNICAST3: DATA, seqno=155, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,730 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #155, conn_id=2) 09:58:49,730 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#155 09:58:49,730 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:49,728 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:58:49,730 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:58:49,730 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:49,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:49,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89594 to Test-NodeA-7051 09:58:49,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #158, conn_id=0) 09:58:49,739 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89594, rsp_expected=true, UNICAST3: DATA, seqno=158, TP: [cluster_name=ISPN] 09:58:49,739 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,739 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:49,737 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:58:49,740 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:58:49,740 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89594, rsp_expected=true, UNICAST3: DATA, seqno=158, TP: [cluster_name=ISPN] 09:58:49,740 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #158, conn_id=0) 09:58:49,740 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:58:49,749 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:58:49,749 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#158 09:58:49,750 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:49,750 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:49,752 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:49,750 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:58:49,752 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-70518 09:58:49,753 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:58:49,753 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:58:49,753 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:58:49,753 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:58:49,755 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:49,755 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:58:49,758 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:49,758 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:58:49,760 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [Test] Completed segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:49,760 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:58:49,761 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:58:49,762 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:58:49,761 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70518 09:58:49,762 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70518 being completed: true 09:58:49,762 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70518 09:58:49,762 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:58:49,763 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:58:49,763 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:58:49,764 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:58:49,764 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:58:49,765 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:58:49,765 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:58:49,765 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:58:49,766 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:58:49,767 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:58:49,768 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:58:49,768 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:58:49,768 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:58:49,768 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:58:49,770 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:58:49,770 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:58:49,770 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:58:49,772 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:58:49,772 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:58:49,773 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:58:49,774 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:58:49,774 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:58:49,775 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [244, 251] 09:58:49,775 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,775 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-8 09:58:49,778 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:49,778 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:49,779 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,779 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-1 09:58:49,780 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,786 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-4 09:58:49,786 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,786 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-3 09:58:49,786 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,786 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-2 09:58:49,786 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,787 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-9 09:58:49,788 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,789 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-7 09:58:49,789 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,789 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-6 09:58:49,790 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [48, 2, 229, 118, 71, 72, 233, 60] 09:58:49,790 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,790 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-to-change-0 09:58:49,791 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_complete_segment_invoked * 1 (available = 1, total = 1) 09:58:49,792 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_complete_segment_released * 1 09:58:49,792 TRACE (testng-Test:[]) [CheckPoint] Received event pre_complete_segment_invoked * 1 (available = 0, total = 1) 09:58:49,794 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4226b98c] 09:58:49,795 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:49,797 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:49,798 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:49,799 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? false 09:58:49,799 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,799 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,799 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:49,799 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,799 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,799 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:49,799 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89614] on Test-NodeC-52778 09:58:49,799 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #156, conn_id=2) 09:58:49,799 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89614, rsp_expected=true, UNICAST3: DATA, seqno=156, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,799 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (208 bytes (1040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,799 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (211 bytes) 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89614, rsp_expected=true, UNICAST3: DATA, seqno=156, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #156, conn_id=2) 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#156 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89614 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:36595. timeout=10000 (MILLISECONDS) 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36595. Timeout=10000 (MILLISECONDS) 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36595} 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36595}. Current=null 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36595}) => true 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36595}. WAITING => ACQUIRED 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36595} successfully acquired the lock. 09:58:49,805 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,805 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,805 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,805 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@63207aa6] 09:58:49,810 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,813 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-to-change-0'? true 09:58:49,814 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:36595. timeout=10000 (MILLISECONDS) 09:58:49,821 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36595. Timeout=10000 (MILLISECONDS) 09:58:49,822 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36595} 09:58:49,825 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:49,825 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:49,825 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,825 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:49,825 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:49,825 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(33ccdcd9){key=key-to-change-0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:49,827 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,828 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,828 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,829 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,830 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:49,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89625] on Test-NodeA-7051 09:58:49,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #159, conn_id=0) 09:58:49,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89625, rsp_expected=true, UNICAST3: DATA, seqno=159, TP: [cluster_name=ISPN] 09:58:49,838 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (208 bytes (1040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,838 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (211 bytes) 09:58:49,845 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89625, rsp_expected=true, UNICAST3: DATA, seqno=159, TP: [cluster_name=ISPN] 09:58:49,846 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #159, conn_id=0) 09:58:49,849 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#159 09:58:49,849 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89625 09:58:49,850 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:49,852 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:49,852 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@584e1af6] 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5df770fa){key=key-to-change-0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,853 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,854 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5df770fa){key=key-to-change-0, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,855 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:49,857 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,857 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,858 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change-0, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:49,864 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-0, value=changed-value} in container 09:58:49,867 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:49,867 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,867 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89625 to Test-NodeC-52778 09:58:49,869 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #157, conn_id=2) 09:58:49,871 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89625, rsp_expected=true, UNICAST3: DATA, seqno=157, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,871 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36595 09:58:49,871 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,871 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (96 bytes) 09:58:49,874 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89625, rsp_expected=true, UNICAST3: DATA, seqno=157, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,875 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #157, conn_id=2) 09:58:49,875 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#157 09:58:49,879 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:49,880 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=initial-value} } 09:58:49,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(33ccdcd9){key=key-to-change-0, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:49,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:49,880 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:49,883 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change-0, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-0, value=changed-value} in container 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_MODIFIED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, key=key-to-change-0, value=changed-value, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@3697f38a[Not completed] to remote execution at node Test-NodeA-7051 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@500d2885] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@500d2885], mode=SYNCHRONOUS, timeout=15000 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@500d2885] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89636] on Test-NodeA-7051 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #160, conn_id=0) 09:58:49,884 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89636, rsp_expected=true, UNICAST3: DATA, seqno=160, TP: [cluster_name=ISPN] 09:58:49,885 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (379 bytes (1895.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,885 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (382 bytes) 09:58:49,885 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=305 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89636, rsp_expected=true, UNICAST3: DATA, seqno=160, TP: [cluster_name=ISPN] 09:58:49,887 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #160, conn_id=0) 09:58:49,888 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#160 09:58:49,892 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89636 09:58:49,893 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3d1f04ad] [sender=Test-NodeC-52778] 09:58:49,893 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:49,893 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,893 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3d1f04ad] 09:58:49,893 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_MODIFIED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=changed-value, oldValue=null, transaction=null, retryCommand=false, origin=Test-NodeC-52778}], notifying cluster listener with id 046f9006-bcd1-44d1-b021-be6d06ddef21 09:58:49,893 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3d1f04ad] 09:58:49,894 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89636 to Test-NodeC-52778 09:58:49,895 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #158, conn_id=2) 09:58:49,896 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89636, rsp_expected=true, UNICAST3: DATA, seqno=158, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,897 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,898 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:49,898 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89636, rsp_expected=true, UNICAST3: DATA, seqno=158, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,898 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #158, conn_id=2) 09:58:49,900 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#158 09:58:49,900 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,903 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@500d2885] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:49,903 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:49,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:36595 09:58:49,905 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36595. 09:58:49,906 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36595}. ACQUIRED => RELEASED 09:58:49,907 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36595}? true 09:58:49,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36595} 09:58:49,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36595}, null) => true 09:58:49,911 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:49,911 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:49,912 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89614 to Test-NodeA-7051 09:58:49,914 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #161, conn_id=0) 09:58:49,930 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89614, rsp_expected=true, UNICAST3: DATA, seqno=161, TP: [cluster_name=ISPN] 09:58:49,932 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:36595 09:58:49,932 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,932 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:58:49,932 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89614, rsp_expected=true, UNICAST3: DATA, seqno=161, TP: [cluster_name=ISPN] 09:58:49,938 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #161, conn_id=0) 09:58:49,938 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#161 09:58:49,938 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:49,942 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=initial-value} } 09:58:49,942 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:49,942 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_complete_segment_released * 999999999 (available = 999999999, total = 999999999) 09:58:49,943 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_complete_segment_released * 1 (available = 999999998, total = 999999999) 09:58:49,945 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:49,945 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:49,947 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:49,948 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:49,948 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:49,948 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:49,948 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:49,948 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 60 09:58:49,948 TRACE (ForkThread-1,Test:[]) [Test] Listener received event ClusterEvent {type=CACHE_ENTRY_MODIFIED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=changed-value, oldValue=null, transaction=null, retryCommand=false, origin=Test-NodeC-52778} 09:58:49,948 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [24] 09:58:49,948 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:49,948 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-5 09:58:49,948 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:49,948 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 046f9006-bcd1-44d1-b021-be6d06ddef21 initial state for cache completed 09:58:49,948 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork runnable. 09:58:49,949 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@36941633[Not completed] to self 09:58:49,949 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@6a2fb1df[Not completed] to remote execution at node Test-NodeB-10318 09:58:49,949 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@56be3de1] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,949 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@56be3de1], mode=SYNCHRONOUS, timeout=15000 09:58:49,950 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@56be3de1] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:49,950 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89654] on Test-NodeB-10318 09:58:49,951 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #90, conn_id=1) 09:58:49,951 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89654, rsp_expected=true, UNICAST3: DATA, seqno=90, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,951 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:49,951 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@75fdcfcc[Not completed] to remote execution at node Test-NodeC-52778 09:58:49,951 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:49,952 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@56be3de1] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,952 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89654, rsp_expected=true, UNICAST3: DATA, seqno=90, conn_id=1, TP: [cluster_name=ISPN] 09:58:49,953 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #90, conn_id=1) 09:58:49,953 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#90 09:58:49,953 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89654 09:58:49,953 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2cfbd2d9] [sender=Test-NodeA-7051] 09:58:49,953 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:49,953 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,953 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2cfbd2d9] 09:58:49,953 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 046f9006-bcd1-44d1-b021-be6d06ddef21 09:58:49,953 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2cfbd2d9] 09:58:49,953 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89654 to Test-NodeA-7051 09:58:49,953 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #92, conn_id=0) 09:58:49,953 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89654, rsp_expected=true, UNICAST3: DATA, seqno=92, TP: [cluster_name=ISPN] 09:58:49,953 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,954 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:49,954 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89654, rsp_expected=true, UNICAST3: DATA, seqno=92, TP: [cluster_name=ISPN] 09:58:49,954 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #92, conn_id=0) 09:58:49,954 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#92 09:58:49,954 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,954 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@56be3de1] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:49,952 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@56be3de1], mode=SYNCHRONOUS, timeout=15000 09:58:49,963 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@56be3de1] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:49,963 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89655] on Test-NodeC-52778 09:58:49,963 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #159, conn_id=2) 09:58:49,963 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89655, rsp_expected=true, UNICAST3: DATA, seqno=159, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,963 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:49,963 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:49,963 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89655, rsp_expected=true, UNICAST3: DATA, seqno=159, conn_id=2, TP: [cluster_name=ISPN] 09:58:49,963 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #159, conn_id=2) 09:58:49,963 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#159 09:58:49,963 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89655 09:58:49,963 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4843f875] [sender=Test-NodeA-7051] 09:58:49,963 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:49,963 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:49,963 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4843f875] 09:58:49,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 046f9006-bcd1-44d1-b021-be6d06ddef21 09:58:49,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4843f875] 09:58:49,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89655 to Test-NodeA-7051 09:58:49,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #162, conn_id=0) 09:58:49,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89655, rsp_expected=true, UNICAST3: DATA, seqno=162, TP: [cluster_name=ISPN] 09:58:49,964 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:49,969 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:49,969 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89655, rsp_expected=true, UNICAST3: DATA, seqno=162, TP: [cluster_name=ISPN] 09:58:49,969 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #162, conn_id=0) 09:58:49,969 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#162 09:58:49,976 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:49,976 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@56be3de1] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:49,977 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered 09:58:49,977 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:49,977 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:49,977 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:49,977 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:49,977 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:49,980 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:49,980 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:58:49,982 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:49,983 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:49,983 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 10 09:58:49,985 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:49,985 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:49,986 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:49,986 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:49,987 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueOwnerClustered 09:58:49,987 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@70e6454a] 09:58:49,987 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:49,990 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:49,990 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:49,997 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:49,997 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:49,997 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:49,997 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:49,998 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:49,999 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:49,999 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:49,999 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89665] on Test-NodeB-10318 09:58:50,000 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #91, conn_id=1) 09:58:50,000 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89665, rsp_expected=true, UNICAST3: DATA, seqno=91, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,003 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,003 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89665, rsp_expected=true, UNICAST3: DATA, seqno=91, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #91, conn_id=1) 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#91 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89665 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:36622. timeout=10000 (MILLISECONDS) 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36622. Timeout=10000 (MILLISECONDS) 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36622} 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36622}. Current=null 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36622}) => true 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36622}. WAITING => ACQUIRED 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36622} successfully acquired the lock. 09:58:50,003 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5b479073] 09:58:50,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:50,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:36622. timeout=10000 (MILLISECONDS) 09:58:50,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36622. Timeout=10000 (MILLISECONDS) 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36622} 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5a692660){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89667] on Test-NodeC-52778 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #39, conn_id=1) 09:58:50,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89667, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,014 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,018 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,065 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89667, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,067 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #39, conn_id=1) 09:58:50,067 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#39 09:58:50,068 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89667 09:58:50,070 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:50,072 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,072 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,075 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@76fa6925] 09:58:50,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:50,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:50,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,085 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,085 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:50,085 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(de6d3fc){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,089 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,089 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #92) 09:58:50,091 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=92, ts=58, TP: [cluster_name=ISPN] 09:58:50,091 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #162) 09:58:50,091 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=162, ts=59, TP: [cluster_name=ISPN] 09:58:50,092 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #39) 09:58:50,092 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=39, conn_id=1, ts=51, TP: [cluster_name=ISPN] 09:58:50,092 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #159) 09:58:50,092 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=159, conn_id=2, ts=52, TP: [cluster_name=ISPN] 09:58:50,095 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #91) 09:58:50,095 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=91, conn_id=1, ts=51, TP: [cluster_name=ISPN] 09:58:50,095 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,095 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:50,095 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=91, conn_id=1, ts=51, TP: [cluster_name=ISPN] 09:58:50,095 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #91, conn-id=1, ts=51) 09:58:50,089 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(de6d3fc){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:50,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:50,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:50,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,092 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,104 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:50,104 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,104 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:50,104 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=159, conn_id=2, ts=52, TP: [cluster_name=ISPN] 09:58:50,104 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #159, conn-id=2, ts=52) 09:58:50,091 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,105 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=39, conn_id=1, ts=51, TP: [cluster_name=ISPN] 09:58:50,105 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #39, conn-id=1, ts=51) 09:58:50,105 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:50,110 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,110 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:50,110 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=92, ts=58, TP: [cluster_name=ISPN] 09:58:50,102 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,111 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89667 to Test-NodeB-10318 09:58:50,111 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #39, conn_id=1) 09:58:50,111 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89667, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,111 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36622 09:58:50,111 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,111 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:50,110 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=162, ts=59, TP: [cluster_name=ISPN] 09:58:50,111 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #162, conn-id=0, ts=59) 09:58:50,110 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #92, conn-id=0, ts=58) 09:58:50,111 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89667, rsp_expected=true, UNICAST3: DATA, seqno=39, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,112 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #39, conn_id=1) 09:58:50,113 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#39 09:58:50,113 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,113 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:50,114 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5a692660){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,114 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:50,114 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,119 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,120 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:50,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:50,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:36622 09:58:50,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36622. 09:58:50,236 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36622}. ACQUIRED => RELEASED 09:58:50,236 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36622}? true 09:58:50,236 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36622} 09:58:50,236 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36622}, null) => true 09:58:50,236 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,236 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,236 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89665 to Test-NodeA-7051 09:58:50,248 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #93, conn_id=0) 09:58:50,248 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89665, rsp_expected=true, UNICAST3: DATA, seqno=93, TP: [cluster_name=ISPN] 09:58:50,248 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:36622 09:58:50,252 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,252 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,262 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89665, rsp_expected=true, UNICAST3: DATA, seqno=93, TP: [cluster_name=ISPN] 09:58:50,262 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #93, conn_id=0) 09:58:50,262 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#93 09:58:50,262 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,262 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:50,262 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,263 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@655cfb28] 09:58:50,263 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,263 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:50,263 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:50,263 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:50,263 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,263 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,263 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:50,263 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,263 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,263 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,263 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89679] on Test-NodeC-52778 09:58:50,263 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #160, conn_id=2) 09:58:50,263 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89679, rsp_expected=true, UNICAST3: DATA, seqno=160, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,263 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,263 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,263 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89679, rsp_expected=true, UNICAST3: DATA, seqno=160, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,263 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #160, conn_id=2) 09:58:50,263 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#160 09:58:50,263 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89679 09:58:50,263 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,263 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,271 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36633. timeout=10000 (MILLISECONDS) 09:58:50,271 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36633. Timeout=10000 (MILLISECONDS) 09:58:50,278 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36633} 09:58:50,280 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36633}. Current=null 09:58:50,282 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36633}) => true 09:58:50,282 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36633}. WAITING => ACQUIRED 09:58:50,283 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36633} successfully acquired the lock. 09:58:50,283 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7d69c1e6] 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:36633. timeout=10000 (MILLISECONDS) 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36633. Timeout=10000 (MILLISECONDS) 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36633} 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(782ab4c2){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:50,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89685] on Test-NodeA-7051 09:58:50,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #163, conn_id=0) 09:58:50,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89685, rsp_expected=true, UNICAST3: DATA, seqno=163, TP: [cluster_name=ISPN] 09:58:50,284 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,284 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:50,286 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89685, rsp_expected=true, UNICAST3: DATA, seqno=163, TP: [cluster_name=ISPN] 09:58:50,287 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #163, conn_id=0) 09:58:50,287 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#163 09:58:50,289 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89685 09:58:50,289 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:50,295 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,297 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,297 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,298 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,298 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4cd07756] 09:58:50,298 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,299 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:50,302 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2a46be96){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2a46be96){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,306 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,307 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89685 to Test-NodeC-52778 09:58:50,307 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #161, conn_id=2) 09:58:50,307 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89685, rsp_expected=true, UNICAST3: DATA, seqno=161, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,307 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36633 09:58:50,307 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,307 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:50,307 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89685, rsp_expected=true, UNICAST3: DATA, seqno=161, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,307 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #161, conn_id=2) 09:58:50,308 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#161 09:58:50,313 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,314 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:50,315 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(782ab4c2){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,316 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:50,318 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:50,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:50,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36633 09:58:50,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36633. 09:58:50,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36633}. ACQUIRED => RELEASED 09:58:50,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36633}? true 09:58:50,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36633} 09:58:50,322 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36633}, null) => true 09:58:50,322 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,323 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,323 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89679 to Test-NodeA-7051 09:58:50,323 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #164, conn_id=0) 09:58:50,323 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89679, rsp_expected=true, UNICAST3: DATA, seqno=164, TP: [cluster_name=ISPN] 09:58:50,323 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:36633 09:58:50,323 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,324 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,324 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89679, rsp_expected=true, UNICAST3: DATA, seqno=164, TP: [cluster_name=ISPN] 09:58:50,325 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #164, conn_id=0) 09:58:50,325 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#164 09:58:50,326 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,326 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:50,327 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,327 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3ce2f9df] 09:58:50,328 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,328 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:50,328 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:50,328 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:50,328 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,328 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,328 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:50,328 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,329 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,329 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,329 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89694] on Test-NodeC-52778 09:58:50,329 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #162, conn_id=2) 09:58:50,329 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89694, rsp_expected=true, UNICAST3: DATA, seqno=162, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,329 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,329 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,330 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89694, rsp_expected=true, UNICAST3: DATA, seqno=162, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,330 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #162, conn_id=2) 09:58:50,332 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#162 09:58:50,332 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89694 09:58:50,332 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,332 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,335 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36639. timeout=10000 (MILLISECONDS) 09:58:50,335 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36639. Timeout=10000 (MILLISECONDS) 09:58:50,340 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36639} 09:58:50,340 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36639}. Current=null 09:58:50,340 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36639}) => true 09:58:50,340 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36639}. WAITING => ACQUIRED 09:58:50,342 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36639} successfully acquired the lock. 09:58:50,345 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,345 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,345 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,345 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@516a7ed0] 09:58:50,350 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,350 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:50,353 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:36639. timeout=10000 (MILLISECONDS) 09:58:50,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36639. Timeout=10000 (MILLISECONDS) 09:58:50,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36639} 09:58:50,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,409 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:50,414 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,414 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:50,420 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(58d0dc75){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,420 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,421 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,421 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,426 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,426 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:50,430 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89707] on Test-NodeB-10318 09:58:50,431 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #40, conn_id=1) 09:58:50,432 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89707, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,432 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,433 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:50,433 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89707, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,433 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #40, conn_id=1) 09:58:50,433 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#40 09:58:50,435 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89707 09:58:50,436 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:50,436 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,437 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,437 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,437 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,437 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4c1aed74] 09:58:50,437 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,437 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:50,438 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,439 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:50,439 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,440 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,441 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:50,442 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6b9170a0){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,442 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,443 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,443 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6b9170a0){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,443 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:50,444 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,444 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,445 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:50,446 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:50,448 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,448 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89707 to Test-NodeC-52778 09:58:50,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #40, conn_id=1) 09:58:50,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89707, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,449 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36639 09:58:50,449 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,449 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:50,450 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89707, rsp_expected=true, UNICAST3: DATA, seqno=40, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,450 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #40, conn_id=1) 09:58:50,450 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#40 09:58:50,450 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,451 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:50,452 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(58d0dc75){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,456 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:50,457 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,457 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:50,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:50,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36639 09:58:50,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36639. 09:58:50,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36639}. ACQUIRED => RELEASED 09:58:50,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36639}? true 09:58:50,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36639} 09:58:50,459 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36639}, null) => true 09:58:50,459 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,459 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,459 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89694 to Test-NodeA-7051 09:58:50,460 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #165, conn_id=0) 09:58:50,461 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89694, rsp_expected=true, UNICAST3: DATA, seqno=165, TP: [cluster_name=ISPN] 09:58:50,462 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:36639 09:58:50,462 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,463 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,463 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89694, rsp_expected=true, UNICAST3: DATA, seqno=165, TP: [cluster_name=ISPN] 09:58:50,463 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #165, conn_id=0) 09:58:50,463 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#165 09:58:50,463 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,464 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:50,464 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,464 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@69617679] 09:58:50,465 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,465 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:50,465 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:50,465 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:50,466 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,466 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,466 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:50,467 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,467 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,468 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,468 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89721] on Test-NodeC-52778 09:58:50,469 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #163, conn_id=2) 09:58:50,469 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89721, rsp_expected=true, UNICAST3: DATA, seqno=163, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,470 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,470 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,476 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89721, rsp_expected=true, UNICAST3: DATA, seqno=163, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,478 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #163, conn_id=2) 09:58:50,478 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#163 09:58:50,479 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89721 09:58:50,479 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,479 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,481 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36652. timeout=10000 (MILLISECONDS) 09:58:50,482 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36652. Timeout=10000 (MILLISECONDS) 09:58:50,482 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36652} 09:58:50,482 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36652}. Current=null 09:58:50,483 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36652}) => true 09:58:50,490 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36652}. WAITING => ACQUIRED 09:58:50,494 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36652} successfully acquired the lock. 09:58:50,495 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,495 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,495 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,496 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1cb4bed5] 09:58:50,496 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,497 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:50,497 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:36652. timeout=10000 (MILLISECONDS) 09:58:50,497 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36652. Timeout=10000 (MILLISECONDS) 09:58:50,497 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36652} 09:58:50,500 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,501 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:50,503 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,503 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,505 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:50,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5e7b06b){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,509 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,509 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,509 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,510 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,510 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:50,511 TRACE (Timer-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:50,511 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:50,511 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:58:50,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89733] on Test-NodeB-10318 09:58:50,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #41, conn_id=1) 09:58:50,511 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:50,512 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89733, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,513 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,513 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:50,513 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89733, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,513 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #41, conn_id=1) 09:58:50,515 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#41 09:58:50,515 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89733 09:58:50,516 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:50,516 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,516 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,516 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,517 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,517 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@14b07489] 09:58:50,517 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:50,520 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:50,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,523 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:50,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(32769841){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,528 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(32769841){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,529 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:50,529 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,530 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,530 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:50,530 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:50,530 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,530 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,530 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89733 to Test-NodeC-52778 09:58:50,530 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #41, conn_id=1) 09:58:50,531 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89733, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,532 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,532 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:50,532 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36652 09:58:50,533 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89733, rsp_expected=true, UNICAST3: DATA, seqno=41, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,535 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #41, conn_id=1) 09:58:50,535 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#41 09:58:50,539 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,542 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:50,542 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5e7b06b){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36652 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36652. 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36652}. ACQUIRED => RELEASED 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36652}? true 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36652} 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36652}, null) => true 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89721 to Test-NodeA-7051 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #166, conn_id=0) 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89721, rsp_expected=true, UNICAST3: DATA, seqno=166, TP: [cluster_name=ISPN] 09:58:50,543 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:36652 09:58:50,543 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,544 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,544 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89721, rsp_expected=true, UNICAST3: DATA, seqno=166, TP: [cluster_name=ISPN] 09:58:50,544 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #166, conn_id=0) 09:58:50,545 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#166 09:58:50,545 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,545 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:50,546 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,546 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5282a930] 09:58:50,547 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,548 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:50,564 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:50,564 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:50,564 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,564 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,564 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:50,564 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,564 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,564 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,565 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89745] on Test-NodeC-52778 09:58:50,565 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #164, conn_id=2) 09:58:50,565 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89745, rsp_expected=true, UNICAST3: DATA, seqno=164, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,565 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,565 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,568 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89745, rsp_expected=true, UNICAST3: DATA, seqno=164, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,568 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #164, conn_id=2) 09:58:50,568 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#164 09:58:50,568 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89745 09:58:50,568 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,569 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,570 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36672. timeout=10000 (MILLISECONDS) 09:58:50,570 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36672. Timeout=10000 (MILLISECONDS) 09:58:50,573 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36672} 09:58:50,575 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36672}. Current=null 09:58:50,575 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36672}) => true 09:58:50,575 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36672}. WAITING => ACQUIRED 09:58:50,577 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36672} successfully acquired the lock. 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@39206e74] 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:36672. timeout=10000 (MILLISECONDS) 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36672. Timeout=10000 (MILLISECONDS) 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36672} 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(66772313){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89748] on Test-NodeA-7051 09:58:50,578 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #167, conn_id=0) 09:58:50,579 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89748, rsp_expected=true, UNICAST3: DATA, seqno=167, TP: [cluster_name=ISPN] 09:58:50,577 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,580 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,580 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:50,581 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89748, rsp_expected=true, UNICAST3: DATA, seqno=167, TP: [cluster_name=ISPN] 09:58:50,582 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #167, conn_id=0) 09:58:50,582 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#167 09:58:50,582 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89748 09:58:50,582 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:50,582 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,582 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,582 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,583 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,583 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@68c23820] 09:58:50,583 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,583 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:50,583 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,584 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:50,584 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,585 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,585 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:50,586 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6096856){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,586 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,586 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,586 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6096856){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,587 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:50,587 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,587 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,587 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:50,588 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:50,588 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,589 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,589 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89748 to Test-NodeC-52778 09:58:50,589 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #165, conn_id=2) 09:58:50,589 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89748, rsp_expected=true, UNICAST3: DATA, seqno=165, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,590 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,590 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36672 09:58:50,590 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:50,591 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #93) 09:58:50,592 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89748, rsp_expected=true, UNICAST3: DATA, seqno=165, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,592 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #165, conn_id=2) 09:58:50,592 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#165 09:58:50,593 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #41) 09:58:50,593 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=41, conn_id=1, ts=53, TP: [cluster_name=ISPN] 09:58:50,593 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #165) 09:58:50,593 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=165, conn_id=2, ts=54, TP: [cluster_name=ISPN] 09:58:50,593 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,592 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,591 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=93, ts=60, TP: [cluster_name=ISPN] 09:58:50,593 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #167) 09:58:50,593 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=167, ts=61, TP: [cluster_name=ISPN] 09:58:50,593 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,594 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:50,594 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,594 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:50,595 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=93, ts=60, TP: [cluster_name=ISPN] 09:58:50,593 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:50,595 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(66772313){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,595 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:50,595 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=41, conn_id=1, ts=53, TP: [cluster_name=ISPN] 09:58:50,595 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,595 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:50,595 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=167, ts=61, TP: [cluster_name=ISPN] 09:58:50,595 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #167, conn-id=0, ts=61) 09:58:50,595 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #41) 09:58:50,595 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=41, conn_id=1, ts=52, TP: [cluster_name=ISPN] 09:58:50,595 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,595 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:50,595 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:50,595 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #93, conn-id=0, ts=60) 09:58:50,600 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=41, conn_id=1, ts=52, TP: [cluster_name=ISPN] 09:58:50,600 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,595 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=165, conn_id=2, ts=54, TP: [cluster_name=ISPN] 09:58:50,602 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,602 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #41, conn-id=1, ts=53) 09:58:50,602 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:50,602 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #165, conn-id=2, ts=54) 09:58:50,602 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #41, conn-id=1, ts=52) 09:58:50,608 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:50,609 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,609 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36672 09:58:50,609 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36672. 09:58:50,609 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36672}. ACQUIRED => RELEASED 09:58:50,609 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36672}? true 09:58:50,609 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36672} 09:58:50,609 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36672}, null) => true 09:58:50,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,612 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89745 to Test-NodeA-7051 09:58:50,614 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #168, conn_id=0) 09:58:50,614 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89745, rsp_expected=true, UNICAST3: DATA, seqno=168, TP: [cluster_name=ISPN] 09:58:50,614 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,614 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,614 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89745, rsp_expected=true, UNICAST3: DATA, seqno=168, TP: [cluster_name=ISPN] 09:58:50,614 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:36672 09:58:50,616 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #168, conn_id=0) 09:58:50,617 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#168 09:58:50,617 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,618 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:50,619 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,619 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@672a8dbe] 09:58:50,620 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,620 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:50,621 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:36684. timeout=10000 (MILLISECONDS) 09:58:50,621 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36684. Timeout=10000 (MILLISECONDS) 09:58:50,622 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36684} 09:58:50,622 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36684}. Current=null 09:58:50,622 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36684}) => true 09:58:50,622 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36684}. WAITING => ACQUIRED 09:58:50,622 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36684} successfully acquired the lock. 09:58:50,622 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:50,622 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:50,622 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,622 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,622 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:50,623 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6a5d8ec1){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,625 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,626 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,626 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:50,626 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,628 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,629 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:50,629 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89760] on Test-NodeB-10318 09:58:50,629 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #92, conn_id=1) 09:58:50,629 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89760, rsp_expected=true, UNICAST3: DATA, seqno=92, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,630 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,630 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:50,630 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89760, rsp_expected=true, UNICAST3: DATA, seqno=92, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,631 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #92, conn_id=1) 09:58:50,632 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#92 09:58:50,633 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89760 09:58:50,633 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,634 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,634 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,634 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,634 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@291ca236] 09:58:50,634 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,642 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,647 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:50,647 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,647 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:50,649 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,651 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:50,655 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4968c3c5){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4968c3c5){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:50,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,660 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:50,660 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:50,660 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,660 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,661 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89760 to Test-NodeA-7051 09:58:50,661 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #94, conn_id=0) 09:58:50,662 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89760, rsp_expected=true, UNICAST3: DATA, seqno=94, TP: [cluster_name=ISPN] 09:58:50,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36684 09:58:50,664 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,665 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,665 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89760, rsp_expected=true, UNICAST3: DATA, seqno=94, TP: [cluster_name=ISPN] 09:58:50,665 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #94, conn_id=0) 09:58:50,665 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#94 09:58:50,666 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,666 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:50,666 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6a5d8ec1){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,669 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:50,669 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,669 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,669 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:50,679 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:50,679 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,684 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:36684 09:58:50,684 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36684. 09:58:50,684 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36684}. ACQUIRED => RELEASED 09:58:50,685 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36684}? true 09:58:50,685 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36684} 09:58:50,685 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36684}, null) => true 09:58:50,686 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,687 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21145a2e] 09:58:50,687 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,688 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:50,693 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:50,693 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:50,694 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,696 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,696 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:50,697 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,698 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,698 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,698 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89777] on Test-NodeC-52778 09:58:50,700 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #166, conn_id=2) 09:58:50,700 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89777, rsp_expected=true, UNICAST3: DATA, seqno=166, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,700 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,702 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,704 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89777, rsp_expected=true, UNICAST3: DATA, seqno=166, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,707 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #166, conn_id=2) 09:58:50,707 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#166 09:58:50,708 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89777 09:58:50,708 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,708 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,708 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36692. timeout=10000 (MILLISECONDS) 09:58:50,708 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36692. Timeout=10000 (MILLISECONDS) 09:58:50,708 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36692} 09:58:50,709 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36692}. Current=null 09:58:50,710 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36692}) => true 09:58:50,710 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36692}. WAITING => ACQUIRED 09:58:50,710 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36692} successfully acquired the lock. 09:58:50,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,715 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@67a7dcde] 09:58:50,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,716 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:50,716 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:36692. timeout=10000 (MILLISECONDS) 09:58:50,717 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36692. Timeout=10000 (MILLISECONDS) 09:58:50,719 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36692} 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(337c7d72){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,721 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,722 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:50,728 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89784] on Test-NodeA-7051 09:58:50,728 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #169, conn_id=0) 09:58:50,728 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89784, rsp_expected=true, UNICAST3: DATA, seqno=169, TP: [cluster_name=ISPN] 09:58:50,728 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,732 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:50,733 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89784, rsp_expected=true, UNICAST3: DATA, seqno=169, TP: [cluster_name=ISPN] 09:58:50,734 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #169, conn_id=0) 09:58:50,735 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#169 09:58:50,735 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89784 09:58:50,735 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:50,736 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,737 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,737 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,737 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,737 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@492cc506] 09:58:50,737 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,738 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:50,738 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,739 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:50,741 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,747 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,747 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:50,749 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(568170bb){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,749 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,749 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(568170bb){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89784 to Test-NodeC-52778 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #167, conn_id=2) 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89784, rsp_expected=true, UNICAST3: DATA, seqno=167, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,752 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,752 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36692 09:58:50,754 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:50,755 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89784, rsp_expected=true, UNICAST3: DATA, seqno=167, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,756 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #167, conn_id=2) 09:58:50,757 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#167 09:58:50,757 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,757 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:50,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(337c7d72){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,757 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:50,758 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,760 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,760 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:50,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:50,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36692 09:58:50,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36692. 09:58:50,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36692}. ACQUIRED => RELEASED 09:58:50,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36692}? true 09:58:50,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36692} 09:58:50,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36692}, null) => true 09:58:50,768 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,770 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,770 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89777 to Test-NodeA-7051 09:58:50,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #170, conn_id=0) 09:58:50,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89777, rsp_expected=true, UNICAST3: DATA, seqno=170, TP: [cluster_name=ISPN] 09:58:50,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:36692 09:58:50,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,772 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89777, rsp_expected=true, UNICAST3: DATA, seqno=170, TP: [cluster_name=ISPN] 09:58:50,773 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #170, conn_id=0) 09:58:50,773 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#170 09:58:50,773 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,774 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:50,774 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,776 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4b1de1a4] 09:58:50,776 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,777 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:50,778 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:50,779 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:50,779 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,779 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,779 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:50,780 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,780 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,780 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,780 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89799] on Test-NodeC-52778 09:58:50,781 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #168, conn_id=2) 09:58:50,781 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89799, rsp_expected=true, UNICAST3: DATA, seqno=168, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,781 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,783 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,783 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89799, rsp_expected=true, UNICAST3: DATA, seqno=168, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,784 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #168, conn_id=2) 09:58:50,784 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#168 09:58:50,784 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89799 09:58:50,785 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,785 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,785 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36704. timeout=10000 (MILLISECONDS) 09:58:50,786 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36704. Timeout=10000 (MILLISECONDS) 09:58:50,787 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36704} 09:58:50,787 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36704}. Current=null 09:58:50,787 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36704}) => true 09:58:50,789 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36704}. WAITING => ACQUIRED 09:58:50,794 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36704} successfully acquired the lock. 09:58:50,795 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,795 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,796 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,796 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@78504a74] 09:58:50,797 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,797 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:50,798 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:36704. timeout=10000 (MILLISECONDS) 09:58:50,798 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36704. Timeout=10000 (MILLISECONDS) 09:58:50,799 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36704} 09:58:50,799 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,799 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:50,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:50,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2b63fa02){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:50,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89807] on Test-NodeA-7051 09:58:50,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #171, conn_id=0) 09:58:50,804 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89807, rsp_expected=true, UNICAST3: DATA, seqno=171, TP: [cluster_name=ISPN] 09:58:50,811 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,811 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:50,811 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89807, rsp_expected=true, UNICAST3: DATA, seqno=171, TP: [cluster_name=ISPN] 09:58:50,811 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #171, conn_id=0) 09:58:50,811 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#171 09:58:50,812 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89807 09:58:50,812 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:50,812 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,812 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,812 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,812 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,812 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2ffb4173] 09:58:50,813 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,813 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:50,813 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,814 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:50,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,820 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:50,820 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(62fdd702){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,822 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,822 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,824 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(62fdd702){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,826 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:50,826 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,826 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:50,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:50,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89807 to Test-NodeC-52778 09:58:50,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #169, conn_id=2) 09:58:50,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89807, rsp_expected=true, UNICAST3: DATA, seqno=169, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,827 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36704 09:58:50,827 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,830 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:50,831 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89807, rsp_expected=true, UNICAST3: DATA, seqno=169, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,831 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #169, conn_id=2) 09:58:50,831 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#169 09:58:50,832 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,833 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:50,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2b63fa02){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:50,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,833 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,834 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:50,835 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:50,837 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,837 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36704 09:58:50,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36704. 09:58:50,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36704}. ACQUIRED => RELEASED 09:58:50,838 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36704}? true 09:58:50,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36704} 09:58:50,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36704}, null) => true 09:58:50,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89799 to Test-NodeA-7051 09:58:50,844 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #172, conn_id=0) 09:58:50,844 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89799, rsp_expected=true, UNICAST3: DATA, seqno=172, TP: [cluster_name=ISPN] 09:58:50,844 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:36704 09:58:50,844 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,844 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,844 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89799, rsp_expected=true, UNICAST3: DATA, seqno=172, TP: [cluster_name=ISPN] 09:58:50,844 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #172, conn_id=0) 09:58:50,844 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#172 09:58:50,844 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,844 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:50,844 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,844 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7433a43a] 09:58:50,844 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,844 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:50,844 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:50,844 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:50,844 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,844 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,844 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:50,844 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,844 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,845 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:50,845 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89816] on Test-NodeB-10318 09:58:50,845 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #93, conn_id=1) 09:58:50,845 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89816, rsp_expected=true, UNICAST3: DATA, seqno=93, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,845 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,845 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:50,845 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89816, rsp_expected=true, UNICAST3: DATA, seqno=93, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,845 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #93, conn_id=1) 09:58:50,845 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#93 09:58:50,845 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89816 09:58:50,846 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36714. timeout=10000 (MILLISECONDS) 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36714. Timeout=10000 (MILLISECONDS) 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36714} 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36714}. Current=null 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36714}) => true 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36714}. WAITING => ACQUIRED 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36714} successfully acquired the lock. 09:58:50,849 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,849 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,851 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,851 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5e6be25d] 09:58:50,852 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,853 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:50,854 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:36714. timeout=10000 (MILLISECONDS) 09:58:50,854 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36714. Timeout=10000 (MILLISECONDS) 09:58:50,854 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36714} 09:58:50,854 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:50,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:50,855 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5859cd41){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,856 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89819] on Test-NodeC-52778 09:58:50,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #42, conn_id=1) 09:58:50,860 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89819, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,860 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,861 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,861 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89819, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,862 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #42, conn_id=1) 09:58:50,862 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#42 09:58:50,862 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89819 09:58:50,862 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:50,862 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,863 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,863 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,865 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,865 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4b2fc42a] 09:58:50,866 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,867 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:50,867 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:50,868 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:50,868 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,868 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,869 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:50,869 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(35ad6347){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,869 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,869 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,869 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(35ad6347){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,869 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:50,871 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,871 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,872 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:50,874 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:50,877 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,877 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,877 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89819 to Test-NodeB-10318 09:58:50,877 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #42, conn_id=1) 09:58:50,877 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89819, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,877 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36714 09:58:50,877 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:50,877 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:50,877 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89819, rsp_expected=true, UNICAST3: DATA, seqno=42, conn_id=1, TP: [cluster_name=ISPN] 09:58:50,882 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #42, conn_id=1) 09:58:50,882 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#42 09:58:50,882 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,882 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:50,883 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5859cd41){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:50,883 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:50,884 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:50,884 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:50,884 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:50,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:50,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36714 09:58:50,887 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36714. 09:58:50,887 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36714}. ACQUIRED => RELEASED 09:58:50,887 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36714}? true 09:58:50,887 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36714} 09:58:50,887 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36714}, null) => true 09:58:50,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:50,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,891 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89816 to Test-NodeA-7051 09:58:50,891 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #95, conn_id=0) 09:58:50,891 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89816, rsp_expected=true, UNICAST3: DATA, seqno=95, TP: [cluster_name=ISPN] 09:58:50,891 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:36714 09:58:50,891 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,891 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:50,892 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89816, rsp_expected=true, UNICAST3: DATA, seqno=95, TP: [cluster_name=ISPN] 09:58:50,896 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #95, conn_id=0) 09:58:50,898 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#95 09:58:50,898 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:50,900 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:50,904 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:50,904 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6dec5abb] 09:58:50,906 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:50,906 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:50,906 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:50,906 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:50,913 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,914 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,917 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:50,919 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,920 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,922 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:50,926 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89841] on Test-NodeC-52778 09:58:50,926 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #170, conn_id=2) 09:58:50,926 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89841, rsp_expected=true, UNICAST3: DATA, seqno=170, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,926 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:50,926 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:50,926 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89841, rsp_expected=true, UNICAST3: DATA, seqno=170, conn_id=2, TP: [cluster_name=ISPN] 09:58:50,926 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #170, conn_id=2) 09:58:50,926 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#170 09:58:50,930 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89841 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36721. timeout=10000 (MILLISECONDS) 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36721. Timeout=10000 (MILLISECONDS) 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36721} 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36721}. Current=null 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36721}) => true 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36721}. WAITING => ACQUIRED 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36721} successfully acquired the lock. 09:58:50,932 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,932 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,932 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,932 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4567fdaf] 09:58:50,936 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,938 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:50,938 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:36721. timeout=10000 (MILLISECONDS) 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36721. Timeout=10000 (MILLISECONDS) 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36721} 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(816750d){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:50,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:50,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:50,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:50,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89844] on Test-NodeA-7051 09:58:50,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #173, conn_id=0) 09:58:50,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89844, rsp_expected=true, UNICAST3: DATA, seqno=173, TP: [cluster_name=ISPN] 09:58:50,943 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:50,944 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:50,946 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89844, rsp_expected=true, UNICAST3: DATA, seqno=173, TP: [cluster_name=ISPN] 09:58:50,946 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #173, conn_id=0) 09:58:50,949 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#173 09:58:50,949 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89844 09:58:50,956 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:50,956 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:50,956 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:50,957 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:50,961 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:50,961 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4dd62aae] 09:58:50,961 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:50,961 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:51,043 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(108f8f07){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(108f8f07){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:51,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89844 to Test-NodeC-52778 09:58:51,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #171, conn_id=2) 09:58:51,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89844, rsp_expected=true, UNICAST3: DATA, seqno=171, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,049 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36721 09:58:51,049 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:51,049 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:51,049 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89844, rsp_expected=true, UNICAST3: DATA, seqno=171, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,049 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #171, conn_id=2) 09:58:51,049 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#171 09:58:51,049 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:51,053 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:51,053 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(816750d){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:51,056 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36721 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36721. 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36721}. ACQUIRED => RELEASED 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36721}? true 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36721} 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36721}, null) => true 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89841 to Test-NodeA-7051 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #174, conn_id=0) 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89841, rsp_expected=true, UNICAST3: DATA, seqno=174, TP: [cluster_name=ISPN] 09:58:51,060 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:36721 09:58:51,061 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,061 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:51,065 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89841, rsp_expected=true, UNICAST3: DATA, seqno=174, TP: [cluster_name=ISPN] 09:58:51,071 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #174, conn_id=0) 09:58:51,077 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#174 09:58:51,077 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:51,077 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:51,077 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:51,077 DEBUG (testng-Test:[]) [Test] Found key key-to-change-1 with primary owner Test-NodeA-7051, segment 175 09:58:51,096 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #93) 09:58:51,096 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=93, conn_id=1, ts=53, TP: [cluster_name=ISPN] 09:58:51,096 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #42) 09:58:51,096 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=42, conn_id=1, ts=54, TP: [cluster_name=ISPN] 09:58:51,096 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,096 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:51,096 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:51,096 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:51,096 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=42, conn_id=1, ts=54, TP: [cluster_name=ISPN] 09:58:51,096 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #42, conn-id=1, ts=54) 09:58:51,099 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=93, conn_id=1, ts=53, TP: [cluster_name=ISPN] 09:58:51,099 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #93, conn-id=1, ts=53) 09:58:51,094 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #42) 09:58:51,101 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=42, conn_id=1, ts=55, TP: [cluster_name=ISPN] 09:58:51,094 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #95) 09:58:51,088 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@a64076d] 09:58:51,104 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:51,104 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-1'? true 09:58:51,104 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change-1 for owner=CommandInvocation:Test-NodeA-7051:36737. timeout=10000 (MILLISECONDS) 09:58:51,104 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36737. Timeout=10000 (MILLISECONDS) 09:58:51,104 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36737} 09:58:51,104 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36737}. Current=null 09:58:51,104 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36737}) => true 09:58:51,104 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36737}. WAITING => ACQUIRED 09:58:51,104 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36737} successfully acquired the lock. 09:58:51,104 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:51,104 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:58:51,104 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,104 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:51,104 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:58:51,104 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3c346378){key=key-to-change-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:51,104 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:51,104 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:51,104 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:51,104 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,104 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:51,104 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:51,104 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89864] on Test-NodeB-10318 09:58:51,102 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=95, ts=62, TP: [cluster_name=ISPN] 09:58:51,101 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:51,105 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #174) 09:58:51,105 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=174, ts=63, TP: [cluster_name=ISPN] 09:58:51,101 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #171) 09:58:51,106 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=171, conn_id=2, ts=56, TP: [cluster_name=ISPN] 09:58:51,105 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:51,106 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:51,107 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=42, conn_id=1, ts=55, TP: [cluster_name=ISPN] 09:58:51,107 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #42, conn-id=1, ts=55) 09:58:51,104 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #94, conn_id=1) 09:58:51,109 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89864, rsp_expected=true, UNICAST3: DATA, seqno=94, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,106 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,106 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:51,111 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:51,111 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (268 bytes (1340.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:51,111 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:51,111 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=171, conn_id=2, ts=56, TP: [cluster_name=ISPN] 09:58:51,111 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #171, conn-id=2, ts=56) 09:58:51,111 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=95, ts=62, TP: [cluster_name=ISPN] 09:58:51,111 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=174, ts=63, TP: [cluster_name=ISPN] 09:58:51,111 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (211 bytes) 09:58:51,112 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89864, rsp_expected=true, UNICAST3: DATA, seqno=94, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,117 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #94, conn_id=1) 09:58:51,112 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #174, conn-id=0, ts=63) 09:58:51,112 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #95, conn-id=0, ts=62) 09:58:51,117 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#94 09:58:51,118 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89864 09:58:51,122 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:51,123 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:51,128 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4ffb3aa5] 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change-1'? false 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1c866b44){key=key-to-change-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1c866b44){key=key-to-change-1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-1, value=initial-value} in container 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89864 to Test-NodeA-7051 09:58:51,130 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #96, conn_id=0) 09:58:51,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89864, rsp_expected=true, UNICAST3: DATA, seqno=96, TP: [cluster_name=ISPN] 09:58:51,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36737 09:58:51,128 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,131 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,132 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:51,134 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89864, rsp_expected=true, UNICAST3: DATA, seqno=96, TP: [cluster_name=ISPN] 09:58:51,134 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #96, conn_id=0) 09:58:51,136 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#96 09:58:51,136 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:51,136 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:51,136 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3c346378){key=key-to-change-1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:51,136 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:58:51,136 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:51,137 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:51,137 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:51,137 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-1, value=initial-value} in container 09:58:51,137 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:51,148 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change-1]. owner=CommandInvocation:Test-NodeA-7051:36737 09:58:51,148 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36737. 09:58:51,148 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36737}. ACQUIRED => RELEASED 09:58:51,162 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36737}? true 09:58:51,165 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36737} 09:58:51,165 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36737}, null) => true 09:58:51,166 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:51,166 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@f049bc3] 09:58:51,166 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,166 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:51,167 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-1 for read. Entry=ImmortalCacheEntry{key=key-to-change-1, value=initial-value} 09:58:51,168 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:51,169 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:51,171 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2df624c2] 09:58:51,173 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,174 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:51,174 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-1 for read. Entry=ImmortalCacheEntry{key=key-to-change-1, value=initial-value} 09:58:51,179 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:51,179 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:51,180 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:58:51,180 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_complete_segment_invoked * 1 09:58:51,180 TRACE (ForkThread-1,Test:[]) [Test] Started fork runnable.. 09:58:51,182 TRACE (ForkThread-1,Test:[]) [Test] Adding segment listener 084b8a4c-1ed2-4d77-977a-528cf6a5b79b : org.infinispan.notifications.cachelistener.DistributedQueueingSegmentListener@4982c896 09:58:51,184 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 084b8a4c-1ed2-4d77-977a-528cf6a5b79b 09:58:51,186 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@73b0cddf[Not completed] to remote execution at node Test-NodeB-10318 09:58:51,187 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@21c100af] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,188 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@21c100af], mode=SYNCHRONOUS, timeout=15000 09:58:51,191 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@21c100af] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:51,191 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89879] on Test-NodeB-10318 09:58:51,191 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #95, conn_id=1) 09:58:51,193 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89879, rsp_expected=true, UNICAST3: DATA, seqno=95, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,195 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@4b5f0e27[Not completed] to remote execution at node Test-NodeC-52778 09:58:51,195 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@21c100af] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,195 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@21c100af], mode=SYNCHRONOUS, timeout=15000 09:58:51,195 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@21c100af] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:51,195 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89880] on Test-NodeC-52778 09:58:51,195 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #172, conn_id=2) 09:58:51,195 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89880, rsp_expected=true, UNICAST3: DATA, seqno=172, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,194 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:51,199 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:51,199 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89879, rsp_expected=true, UNICAST3: DATA, seqno=95, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,199 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #95, conn_id=1) 09:58:51,199 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:51,200 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:51,200 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89880, rsp_expected=true, UNICAST3: DATA, seqno=172, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,200 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#95 09:58:51,208 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89879 09:58:51,209 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@118e42d9] [sender=Test-NodeA-7051] 09:58:51,209 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:51,209 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,209 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@118e42d9] 09:58:51,207 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #172, conn_id=2) 09:58:51,210 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#172 09:58:51,210 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89880 09:58:51,210 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@67d03678] [sender=Test-NodeA-7051] 09:58:51,210 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:51,210 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@67d03678] 09:58:51,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 084b8a4c-1ed2-4d77-977a-528cf6a5b79b 09:58:51,209 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 084b8a4c-1ed2-4d77-977a-528cf6a5b79b 09:58:51,222 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@118e42d9] 09:58:51,222 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@67d03678] 09:58:51,219 TRACE (Timer-3,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:51,223 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89880 to Test-NodeA-7051 09:58:51,223 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89879 to Test-NodeA-7051 09:58:51,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #97, conn_id=0) 09:58:51,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89879, rsp_expected=true, UNICAST3: DATA, seqno=97, TP: [cluster_name=ISPN] 09:58:51,231 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,228 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #175, conn_id=0) 09:58:51,228 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:51,234 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,234 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:51,231 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89880, rsp_expected=true, UNICAST3: DATA, seqno=175, TP: [cluster_name=ISPN] 09:58:51,234 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:51,231 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:51,234 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89879, rsp_expected=true, UNICAST3: DATA, seqno=97, TP: [cluster_name=ISPN] 09:58:51,234 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #97, conn_id=0) 09:58:51,234 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#97 09:58:51,240 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,240 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:51,240 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89880, rsp_expected=true, UNICAST3: DATA, seqno=175, TP: [cluster_name=ISPN] 09:58:51,241 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #175, conn_id=0) 09:58:51,240 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:51,242 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@21c100af] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:51,241 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#175 09:58:51,244 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:51,247 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@21c100af] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:51,247 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 084b8a4c-1ed2-4d77-977a-528cf6a5b79b requests initial state for cache 09:58:51,247 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@5982cec6] 09:58:51,247 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:51,249 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:51,249 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-70519 09:58:51,252 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-70519 excluding keys [] 09:58:51,254 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,254 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:51,255 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:51,255 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:51,255 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89892] on Test-NodeB-10318 09:58:51,256 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #96, conn_id=1) 09:58:51,256 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89892, rsp_expected=true, UNICAST3: DATA, seqno=96, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,257 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (651 bytes (3255.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:51,257 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (654 bytes) 09:58:51,257 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=577 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89892, rsp_expected=true, UNICAST3: DATA, seqno=96, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,257 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #96, conn_id=1) 09:58:51,258 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#96 09:58:51,258 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89892 09:58:51,258 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:51,259 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:51,259 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,259 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:51,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70519 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:51,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7649e650] 09:58:51,267 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:51,270 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70519 09:58:51,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70519 09:58:51,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70519 09:58:51,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:51,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70519 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:51,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70519 09:58:51,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,272 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:51,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:51,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89896] on Test-NodeA-7051 09:58:51,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #98, conn_id=0) 09:58:51,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89896, rsp_expected=true, UNICAST3: DATA, seqno=98, TP: [cluster_name=ISPN] 09:58:51,273 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (224 bytes (1120.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,275 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (227 bytes) 09:58:51,275 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=150 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89896, rsp_expected=true, UNICAST3: DATA, seqno=98, TP: [cluster_name=ISPN] 09:58:51,281 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #98, conn_id=0) 09:58:51,282 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#98 09:58:51,282 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89896 09:58:51,285 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:51,285 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:51,287 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,287 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:51,287 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-70519 with [] suspected segments. 09:58:51,287 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:51,289 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:51,289 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 117, 247, 248, 252, 254, 127] 09:58:51,289 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:51,292 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89896 to Test-NodeB-10318 09:58:51,292 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #97, conn_id=1) 09:58:51,292 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89896, rsp_expected=true, UNICAST3: DATA, seqno=97, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,293 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:51,293 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:51,294 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89896, rsp_expected=true, UNICAST3: DATA, seqno=97, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,298 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #97, conn_id=1) 09:58:51,298 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#97 09:58:51,303 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:51,303 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:51,309 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:51,309 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89892 to Test-NodeA-7051 09:58:51,309 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #99, conn_id=0) 09:58:51,309 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89892, rsp_expected=true, UNICAST3: DATA, seqno=99, TP: [cluster_name=ISPN] 09:58:51,309 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,309 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:51,311 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89892, rsp_expected=true, UNICAST3: DATA, seqno=99, TP: [cluster_name=ISPN] 09:58:51,312 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #99, conn_id=0) 09:58:51,312 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#99 09:58:51,312 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:51,316 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:51,322 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-70519 excluding keys [] 09:58:51,329 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,332 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:51,336 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:51,337 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:51,338 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89911] on Test-NodeC-52778 09:58:51,338 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #173, conn_id=2) 09:58:51,338 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89911, rsp_expected=true, UNICAST3: DATA, seqno=173, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,340 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (606 bytes (3030.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:51,341 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (609 bytes) 09:58:51,346 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=532 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89911, rsp_expected=true, UNICAST3: DATA, seqno=173, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,346 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #173, conn_id=2) 09:58:51,346 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#173 09:58:51,349 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,350 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-0 09:58:51,352 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:58:51,350 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89911 09:58:51,352 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:51,352 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:58:51,353 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:58:51,353 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:58:51,353 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:51,354 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:51,354 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,354 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:58:51,355 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:58:51,355 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-70519 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:51,360 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:58:51,366 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:58:51,364 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@33943b27] 09:58:51,369 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:58:51,369 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:58:51,370 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [244, 251] 09:58:51,370 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,370 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-8 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:51,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:51,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:51,384 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-70519 09:58:51,386 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-70519 09:58:51,387 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-70519 09:58:51,388 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:51,393 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-70519 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:51,393 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-70519 09:58:51,393 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,398 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:51,398 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:51,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=89930] on Test-NodeA-7051 09:58:51,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #176, conn_id=0) 09:58:51,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89930, rsp_expected=true, UNICAST3: DATA, seqno=176, TP: [cluster_name=ISPN] 09:58:51,404 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (314 bytes (1570.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,406 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (317 bytes) 09:58:51,406 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=240 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89930, rsp_expected=true, UNICAST3: DATA, seqno=176, TP: [cluster_name=ISPN] 09:58:51,415 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #176, conn_id=0) 09:58:51,415 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#176 09:58:51,421 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89930 09:58:51,421 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:51,422 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:51,422 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:51,422 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,424 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-70519 with [] suspected segments. 09:58:51,432 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:51,432 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:51,434 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [129, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 180, 181, 60, 63, 67, 195, 69, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 103, 107, 108, 236, 239, 240, 113, 241, 245, 119, 120, 249, 122, 124, 253] 09:58:51,434 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-70519 as completed! 09:58:51,436 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:51,436 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 89930 to Test-NodeC-52778 09:58:51,437 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #174, conn_id=2) 09:58:51,446 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89930, rsp_expected=true, UNICAST3: DATA, seqno=174, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,450 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:51,450 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:51,450 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89930, rsp_expected=true, UNICAST3: DATA, seqno=174, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,472 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #174, conn_id=2) 09:58:51,470 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,477 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-1 09:58:51,485 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 129 09:58:51,475 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#174 09:58:51,486 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:51,485 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 130 09:58:51,486 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 131 09:58:51,486 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 4 09:58:51,486 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 132 09:58:51,486 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:51,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:51,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89911 to Test-NodeA-7051 09:58:51,487 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 133 09:58:51,488 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 135 09:58:51,488 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 8 09:58:51,489 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 10 09:58:51,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #177, conn_id=0) 09:58:51,491 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89911, rsp_expected=true, UNICAST3: DATA, seqno=177, TP: [cluster_name=ISPN] 09:58:51,489 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 139 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 14 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 15 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 16 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 18 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 19 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 147 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 148 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 21 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 151 09:58:51,495 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 153 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 30 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 158 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 31 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 159 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 164 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 40 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 41 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 45 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 47 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 180 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 181 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 60 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 63 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 67 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 195 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 69 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 201 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 74 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 203 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 76 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 205 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 78 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 81 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 82 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 210 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 83 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 85 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 86 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 90 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 219 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 93 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 94 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 222 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 96 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 224 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 98 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 99 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 227 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 228 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 103 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 107 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 108 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 236 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 239 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 240 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 113 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 241 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 245 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 119 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 120 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 249 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 122 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 124 09:58:51,496 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 253 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-4 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-3 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-2 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-9 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-7 09:58:51,496 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [48, 2, 229, 118, 71, 72, 233] 09:58:51,497 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,497 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-6 09:58:51,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:51,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:51,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:51,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:51,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:51,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:51,497 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:51,504 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,504 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:51,512 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89911, rsp_expected=true, UNICAST3: DATA, seqno=177, TP: [cluster_name=ISPN] 09:58:51,512 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #177, conn_id=0) 09:58:51,512 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#177 09:58:51,517 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:51,517 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:51,518 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:51,518 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 2 for id Test-NodeA-70519 09:58:51,520 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:51,528 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 2 09:58:51,527 TRACE (Timer-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:51,529 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:51,535 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:58:51,535 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:51,528 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [Test] Completed segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:51,536 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-70519 09:58:51,537 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-70519 being completed: true 09:58:51,544 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-70519 09:58:51,544 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,544 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-5 09:58:51,544 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:51,544 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:51,544 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:51,545 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:51,545 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [24, 175] 09:58:51,545 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-1, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,545 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-to-change-1 09:58:51,545 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_complete_segment_invoked * 1 (available = 1, total = 1) 09:58:51,545 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_complete_segment_released * 1 09:58:51,545 TRACE (testng-Test:[]) [CheckPoint] Received event pre_complete_segment_invoked * 1 (available = 0, total = 1) 09:58:51,546 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@c742c83] 09:58:51,546 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:51,546 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-1'? true 09:58:51,546 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change-1 for owner=CommandInvocation:Test-NodeA-7051:36979. timeout=10000 (MILLISECONDS) 09:58:51,546 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:36979. Timeout=10000 (MILLISECONDS) 09:58:51,546 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36979} 09:58:51,546 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36979}. Current=null 09:58:51,546 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:36979}) => true 09:58:51,546 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36979}. WAITING => ACQUIRED 09:58:51,546 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:36979} successfully acquired the lock. 09:58:51,546 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:51,546 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:58:51,546 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,547 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:51,547 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:58:51,547 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(36970bfa){key=key-to-change-1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:51,547 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:51,547 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:51,547 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:51,547 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,547 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:51,547 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:51,547 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89947] on Test-NodeB-10318 09:58:51,547 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #98, conn_id=1) 09:58:51,547 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89947, rsp_expected=true, UNICAST3: DATA, seqno=98, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,547 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (208 bytes (1040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:51,547 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (211 bytes) 09:58:51,547 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89947, rsp_expected=true, UNICAST3: DATA, seqno=98, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,548 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #98, conn_id=1) 09:58:51,552 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#98 09:58:51,552 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89947 09:58:51,553 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:51,553 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:51,553 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:51,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:51,553 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@12c27597] 09:58:51,554 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:51,554 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change-1'? false 09:58:51,554 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:51,554 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:58:51,561 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,561 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:51,561 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:58:51,561 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(11f47521){key=key-to-change-1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:51,561 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:51,561 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:51,562 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(11f47521){key=key-to-change-1, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:51,562 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:58:51,562 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:51,565 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:51,565 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change-1, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:51,565 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-1, value=changed-value} in container 09:58:51,567 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:51,567 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:51,567 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89947 to Test-NodeA-7051 09:58:51,567 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #100, conn_id=0) 09:58:51,579 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89947, rsp_expected=true, UNICAST3: DATA, seqno=100, TP: [cluster_name=ISPN] 09:58:51,579 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:36979 09:58:51,579 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,579 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:58:51,583 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89947, rsp_expected=true, UNICAST3: DATA, seqno=100, TP: [cluster_name=ISPN] 09:58:51,583 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #100, conn_id=0) 09:58:51,583 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#100 09:58:51,583 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:51,586 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:58:51,589 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(36970bfa){key=key-to-change-1, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:51,589 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:58:51,589 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:51,589 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:51,589 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change-1, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:51,589 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-1, value=changed-value} in container 09:58:51,590 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:51,590 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change-1]. owner=CommandInvocation:Test-NodeA-7051:36979 09:58:51,590 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:36979. 09:58:51,590 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36979}. ACQUIRED => RELEASED 09:58:51,590 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36979}? true 09:58:51,596 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #98) 09:58:51,596 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=98, conn_id=1, ts=55, TP: [cluster_name=ISPN] 09:58:51,596 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,596 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:51,596 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=98, conn_id=1, ts=55, TP: [cluster_name=ISPN] 09:58:51,596 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #98, conn-id=1, ts=55) 09:58:51,592 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36979} 09:58:51,600 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:36979}, null) => true 09:58:51,600 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:51,600 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_complete_segment_released * 999999999 (available = 999999999, total = 999999999) 09:58:51,600 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_complete_segment_released * 1 (available = 999999998, total = 999999999) 09:58:51,601 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:51,601 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:51,601 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_MODIFIED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-1, value=changed-value, oldValue=initial-value, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:51,601 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 084b8a4c-1ed2-4d77-977a-528cf6a5b79b initial state for cache completed 09:58:51,602 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork runnable. 09:58:51,602 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@6711baa9[Not completed] to self 09:58:51,602 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@305c5012[Not completed] to remote execution at node Test-NodeB-10318 09:58:51,602 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@49e6f38f] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,603 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@49e6f38f], mode=SYNCHRONOUS, timeout=15000 09:58:51,603 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@49e6f38f] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:51,603 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89954] on Test-NodeB-10318 09:58:51,603 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #99, conn_id=1) 09:58:51,603 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89954, rsp_expected=true, UNICAST3: DATA, seqno=99, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,604 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:51,604 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@71930fa1[Not completed] to remote execution at node Test-NodeC-52778 09:58:51,604 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@49e6f38f] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,604 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@49e6f38f], mode=SYNCHRONOUS, timeout=15000 09:58:51,604 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@49e6f38f] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:51,604 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89955] on Test-NodeC-52778 09:58:51,604 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #175, conn_id=2) 09:58:51,604 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89955, rsp_expected=true, UNICAST3: DATA, seqno=175, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,606 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #174) 09:58:51,606 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=174, conn_id=2, ts=57, TP: [cluster_name=ISPN] 09:58:51,607 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #100) 09:58:51,607 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=100, ts=64, TP: [cluster_name=ISPN] 09:58:51,607 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #177) 09:58:51,608 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=177, ts=65, TP: [cluster_name=ISPN] 09:58:51,604 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:51,612 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,612 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:51,614 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=174, conn_id=2, ts=57, TP: [cluster_name=ISPN] 09:58:51,608 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89954, rsp_expected=true, UNICAST3: DATA, seqno=99, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,608 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 3 msgs (332 bytes (1660.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:51,618 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (231 bytes) 09:58:51,618 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #99, conn_id=1) 09:58:51,619 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#99 09:58:51,619 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:51,619 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89954 09:58:51,619 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6fdbabb0] [sender=Test-NodeA-7051] 09:58:51,619 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:51,619 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6fdbabb0] 09:58:51,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 084b8a4c-1ed2-4d77-977a-528cf6a5b79b 09:58:51,619 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #174, conn-id=2, ts=57) 09:58:51,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6fdbabb0] 09:58:51,620 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89954 to Test-NodeA-7051 09:58:51,620 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=100, ts=64, TP: [cluster_name=ISPN] 09:58:51,620 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #100, conn-id=0, ts=64) 09:58:51,621 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89955, rsp_expected=true, UNICAST3: DATA, seqno=175, conn_id=2, TP: [cluster_name=ISPN] 09:58:51,621 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #175, conn_id=2) 09:58:51,621 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#175 09:58:51,621 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89955 09:58:51,621 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5207db5a] [sender=Test-NodeA-7051] 09:58:51,621 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:51,621 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5207db5a] 09:58:51,621 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received message batch of 1 messages from Test-NodeA-7051 09:58:51,621 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #177, conn-id=0, ts=65) 09:58:51,621 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 084b8a4c-1ed2-4d77-977a-528cf6a5b79b 09:58:51,620 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #101, conn_id=0) 09:58:51,639 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89954, rsp_expected=true, UNICAST3: DATA, seqno=101, TP: [cluster_name=ISPN] 09:58:51,639 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,640 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:51,640 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89954, rsp_expected=true, UNICAST3: DATA, seqno=101, TP: [cluster_name=ISPN] 09:58:51,652 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5207db5a] 09:58:51,653 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #101, conn_id=0) 09:58:51,652 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89955 to Test-NodeA-7051 09:58:51,654 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#101 09:58:51,655 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:51,655 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@49e6f38f] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:51,655 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #178, conn_id=0) 09:58:51,664 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89955, rsp_expected=true, UNICAST3: DATA, seqno=178, TP: [cluster_name=ISPN] 09:58:51,665 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:51,665 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:51,667 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89955, rsp_expected=true, UNICAST3: DATA, seqno=178, TP: [cluster_name=ISPN] 09:58:51,668 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #178, conn_id=0) 09:58:51,669 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#178 09:58:51,670 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:51,671 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@49e6f38f] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:51,671 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganAndSegmentNotCompleteValueOwnerClustered 09:58:51,672 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:51,677 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:51,678 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:51,681 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:51,681 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:51,681 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:51,681 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:51,684 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:51,684 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:51,684 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:51,684 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:51,684 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:51,685 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:51,687 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:51,687 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganButNotIteratedValueYetNonOwnerClustered 09:58:51,687 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@62981bf2] 09:58:51,687 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:51,687 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:51,688 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:51,697 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:51,700 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:51,701 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:51,701 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:51,701 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,703 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:51,705 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:51,705 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=89963] on Test-NodeB-10318 09:58:51,706 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #100, conn_id=1) 09:58:51,706 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89963, rsp_expected=true, UNICAST3: DATA, seqno=100, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,715 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:51,715 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:51,715 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89963, rsp_expected=true, UNICAST3: DATA, seqno=100, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,721 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #100, conn_id=1) 09:58:51,733 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#100 09:58:51,738 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89963 09:58:51,748 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:51,759 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:51,822 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37062. timeout=10000 (MILLISECONDS) 09:58:51,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37062. Timeout=10000 (MILLISECONDS) 09:58:51,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37062} 09:58:51,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37062}. Current=null 09:58:51,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37062}) => true 09:58:51,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37062}. WAITING => ACQUIRED 09:58:51,842 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37062} successfully acquired the lock. 09:58:51,843 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:51,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:51,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@183c7c51] 09:58:51,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:51,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:51,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37062. timeout=10000 (MILLISECONDS) 09:58:51,843 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37062. Timeout=10000 (MILLISECONDS) 09:58:51,879 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37062} 09:58:51,885 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:51,885 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:51,905 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,905 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:51,911 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:51,911 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(40838411){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:51,914 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:51,914 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:51,930 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:51,937 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:51,937 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:51,937 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=89981] on Test-NodeC-52778 09:58:51,937 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #43, conn_id=1) 09:58:51,937 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89981, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,937 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:51,937 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:51,938 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=89981, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=1, TP: [cluster_name=ISPN] 09:58:51,938 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #43, conn_id=1) 09:58:51,945 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#43 09:58:51,948 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 89981 09:58:51,967 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:51,972 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:51,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:51,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:51,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2bc401df] 09:58:51,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:51,973 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:51,972 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:51,979 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:51,979 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:51,993 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:51,993 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:51,993 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:51,996 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(79bba53){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,009 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,027 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,029 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(79bba53){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,029 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:52,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,035 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,035 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:52,035 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:52,038 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,048 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,048 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 89981 to Test-NodeB-10318 09:58:52,052 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #43, conn_id=1) 09:58:52,054 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89981, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,054 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37062 09:58:52,056 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,056 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:52,058 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89981, rsp_expected=true, UNICAST3: DATA, seqno=43, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,061 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #43, conn_id=1) 09:58:52,061 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#43 09:58:52,063 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,063 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(40838411){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:52,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37062 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37062. 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37062}. ACQUIRED => RELEASED 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37062}? true 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37062} 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37062}, null) => true 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 89963 to Test-NodeA-7051 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #102, conn_id=0) 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89963, rsp_expected=true, UNICAST3: DATA, seqno=102, TP: [cluster_name=ISPN] 09:58:52,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37062 09:58:52,067 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,075 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,083 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=89963, rsp_expected=true, UNICAST3: DATA, seqno=102, TP: [cluster_name=ISPN] 09:58:52,083 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #102, conn_id=0) 09:58:52,085 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#102 09:58:52,085 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,085 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:52,085 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,085 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@69ef50] 09:58:52,085 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,085 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:52,085 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:52,085 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:52,085 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,085 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,085 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:52,085 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,085 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,085 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,085 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90003] on Test-NodeC-52778 09:58:52,085 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #176, conn_id=2) 09:58:52,085 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90003, rsp_expected=true, UNICAST3: DATA, seqno=176, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,085 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,085 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:52,085 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90003, rsp_expected=true, UNICAST3: DATA, seqno=176, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #176, conn_id=2) 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#176 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90003 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37178. timeout=10000 (MILLISECONDS) 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37178. Timeout=10000 (MILLISECONDS) 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37178} 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37178}. Current=null 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37178}) => true 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37178}. WAITING => ACQUIRED 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37178} successfully acquired the lock. 09:58:52,086 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@25431a33] 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37178. timeout=10000 (MILLISECONDS) 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37178. Timeout=10000 (MILLISECONDS) 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37178} 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(17eeb011){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90004] on Test-NodeA-7051 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #179, conn_id=0) 09:58:52,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90004, rsp_expected=true, UNICAST3: DATA, seqno=179, TP: [cluster_name=ISPN] 09:58:52,086 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,086 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:52,086 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90004, rsp_expected=true, UNICAST3: DATA, seqno=179, TP: [cluster_name=ISPN] 09:58:52,086 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #179, conn_id=0) 09:58:52,089 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#179 09:58:52,089 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90004 09:58:52,089 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:52,089 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,089 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,089 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,089 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@153cee14] 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(79a7bc03){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(79a7bc03){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:52,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:52,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:52,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,096 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #100) 09:58:52,096 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=100, conn_id=1, ts=56, TP: [cluster_name=ISPN] 09:58:52,096 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #43) 09:58:52,096 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=43, conn_id=1, ts=57, TP: [cluster_name=ISPN] 09:58:52,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90004 to Test-NodeC-52778 09:58:52,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #177, conn_id=2) 09:58:52,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90004, rsp_expected=true, UNICAST3: DATA, seqno=177, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37178 09:58:52,099 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,099 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:52,096 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,109 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #43) 09:58:52,109 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #102) 09:58:52,110 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=102, ts=66, TP: [cluster_name=ISPN] 09:58:52,110 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #179) 09:58:52,110 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,110 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:52,110 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=102, ts=66, TP: [cluster_name=ISPN] 09:58:52,110 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #102, conn-id=0, ts=66) 09:58:52,110 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=179, ts=67, TP: [cluster_name=ISPN] 09:58:52,110 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=43, conn_id=1, ts=58, TP: [cluster_name=ISPN] 09:58:52,114 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #176) 09:58:52,114 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=176, conn_id=2, ts=59, TP: [cluster_name=ISPN] 09:58:52,114 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,100 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:52,115 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,100 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90004, rsp_expected=true, UNICAST3: DATA, seqno=177, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,115 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #177, conn_id=2) 09:58:52,115 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#177 09:58:52,115 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,115 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(17eeb011){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37178 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37178. 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37178}. ACQUIRED => RELEASED 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37178}? true 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37178} 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37178}, null) => true 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90003 to Test-NodeA-7051 09:58:52,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #180, conn_id=0) 09:58:52,116 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90003, rsp_expected=true, UNICAST3: DATA, seqno=180, TP: [cluster_name=ISPN] 09:58:52,116 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37178 09:58:52,115 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=100, conn_id=1, ts=56, TP: [cluster_name=ISPN] 09:58:52,115 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:52,117 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=43, conn_id=1, ts=57, TP: [cluster_name=ISPN] 09:58:52,114 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:52,114 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,117 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=179, ts=67, TP: [cluster_name=ISPN] 09:58:52,117 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:52,122 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (138 bytes (690.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,122 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=43, conn_id=1, ts=58, TP: [cluster_name=ISPN] 09:58:52,122 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #43, conn-id=1, ts=58) 09:58:52,117 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #43, conn-id=1, ts=57) 09:58:52,116 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #100, conn-id=1, ts=56) 09:58:52,122 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (97 bytes) 09:58:52,126 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received message batch of 1 messages from Test-NodeC-52778 09:58:52,117 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #179, conn-id=0, ts=67) 09:58:52,126 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #176, conn-id=2, ts=59) 09:58:52,126 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90003, rsp_expected=true, UNICAST3: DATA, seqno=180, TP: [cluster_name=ISPN] 09:58:52,127 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #180, conn_id=0) 09:58:52,132 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#180 09:58:52,132 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,132 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,132 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,132 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3d41dcdf] 09:58:52,132 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,132 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:52,132 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:52,132 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:52,132 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,132 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,132 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:52,132 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,132 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,132 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,132 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90011] on Test-NodeC-52778 09:58:52,132 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #178, conn_id=2) 09:58:52,132 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90011, rsp_expected=true, UNICAST3: DATA, seqno=178, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,132 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,137 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:52,137 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90011, rsp_expected=true, UNICAST3: DATA, seqno=178, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #178, conn_id=2) 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#178 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90011 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37181. timeout=10000 (MILLISECONDS) 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37181. Timeout=10000 (MILLISECONDS) 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37181} 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37181}. Current=null 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37181}) => true 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37181}. WAITING => ACQUIRED 09:58:52,195 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37181} successfully acquired the lock. 09:58:52,196 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@580a2827] 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37181. timeout=10000 (MILLISECONDS) 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37181. Timeout=10000 (MILLISECONDS) 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37181} 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3c770b4f){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90013] on Test-NodeB-10318 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #44, conn_id=1) 09:58:52,196 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90013, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,196 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,196 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:52,197 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90013, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,197 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #44, conn_id=1) 09:58:52,213 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#44 09:58:52,213 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90013 09:58:52,213 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:52,215 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,215 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,217 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,266 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,266 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1ee9201d] 09:58:52,267 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,267 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:52,267 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,267 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:52,267 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,279 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:52,301 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(732aaa7f){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,302 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,308 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,308 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(732aaa7f){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,308 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:52,308 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,308 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,308 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:52,312 TRACE (Timer-3,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:52,312 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:52,317 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,317 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:52,317 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:52,317 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeB-10318: mine: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:52,311 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:52,319 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,319 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,319 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90013 to Test-NodeC-52778 09:58:52,319 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #44, conn_id=1) 09:58:52,319 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90013, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,319 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37181 09:58:52,319 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,317 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:52,319 TRACE (INT-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:58:52,319 TRACE (INT-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 6 from Test-NodeA-7051 09:58:52,319 TRACE (INT-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 0 from Test-NodeB-10318 09:58:52,319 TRACE (INT-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 0 from Test-NodeC-52778 09:58:52,320 TRACE (Timer-3,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stability msg Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:52,320 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:52,320 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:58:52,322 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:52,320 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (120 bytes (600.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:58:52,328 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (123 bytes) 09:58:52,328 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:52,329 TRACE (INT-2,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: received stability msg from Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:52,319 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:52,332 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90013, rsp_expected=true, UNICAST3: DATA, seqno=44, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,329 TRACE (INT-2,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:52,328 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (123 bytes) 09:58:52,333 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:52,333 TRACE (INT-2,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:58:52,338 TRACE (INT-2,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 6 from Test-NodeA-7051 09:58:52,339 TRACE (INT-2,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 0 from Test-NodeB-10318 09:58:52,339 TRACE (INT-2,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 0 from Test-NodeC-52778 09:58:52,332 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #44, conn_id=1) 09:58:52,343 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#44 09:58:52,343 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,343 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:52,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3c770b4f){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:52,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:52,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:52,338 TRACE (INT-2,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: received stability msg from Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:52,345 TRACE (INT-2,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:58:52,346 TRACE (INT-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:58:52,346 TRACE (INT-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 6 from Test-NodeA-7051 09:58:52,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,346 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37181 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37181. 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37181}. ACQUIRED => RELEASED 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37181}? true 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37181} 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37181}, null) => true 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90011 to Test-NodeA-7051 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #181, conn_id=0) 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90011, rsp_expected=true, UNICAST3: DATA, seqno=181, TP: [cluster_name=ISPN] 09:58:52,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37181 09:58:52,347 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,347 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,349 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90011, rsp_expected=true, UNICAST3: DATA, seqno=181, TP: [cluster_name=ISPN] 09:58:52,349 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #181, conn_id=0) 09:58:52,349 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#181 09:58:52,349 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,349 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,349 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,349 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@75fe1b5a] 09:58:52,349 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,349 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:52,351 TRACE (INT-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 0 from Test-NodeB-10318 09:58:52,353 TRACE (INT-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 0 from Test-NodeC-52778 09:58:52,349 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:52,353 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:52,359 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,359 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,359 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:52,359 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,361 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,362 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,362 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90034] on Test-NodeC-52778 09:58:52,362 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #179, conn_id=2) 09:58:52,362 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90034, rsp_expected=true, UNICAST3: DATA, seqno=179, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,362 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,364 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90034, rsp_expected=true, UNICAST3: DATA, seqno=179, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #179, conn_id=2) 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#179 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90034 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37246. timeout=10000 (MILLISECONDS) 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37246. Timeout=10000 (MILLISECONDS) 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37246} 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37246}. Current=null 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37246}) => true 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37246}. WAITING => ACQUIRED 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37246} successfully acquired the lock. 09:58:52,368 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@15151d3b] 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37246. timeout=10000 (MILLISECONDS) 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37246. Timeout=10000 (MILLISECONDS) 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37246} 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7a14bcd8){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,368 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:52,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90037] on Test-NodeB-10318 09:58:52,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #45, conn_id=1) 09:58:52,369 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90037, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,369 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,369 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:52,369 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90037, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,369 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #45, conn_id=1) 09:58:52,369 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#45 09:58:52,369 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90037 09:58:52,369 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:52,369 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,369 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3f319c32] 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7527bd0c){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7527bd0c){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:52,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90037 to Test-NodeC-52778 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #45, conn_id=1) 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90037, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37246 09:58:52,370 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,370 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:52,370 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90037, rsp_expected=true, UNICAST3: DATA, seqno=45, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,370 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #45, conn_id=1) 09:58:52,370 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#45 09:58:52,370 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,370 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7a14bcd8){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37246 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37246. 09:58:52,370 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37246}. ACQUIRED => RELEASED 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37246}? true 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37246} 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37246}, null) => true 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90034 to Test-NodeA-7051 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #182, conn_id=0) 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90034, rsp_expected=true, UNICAST3: DATA, seqno=182, TP: [cluster_name=ISPN] 09:58:52,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37246 09:58:52,371 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,371 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,371 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90034, rsp_expected=true, UNICAST3: DATA, seqno=182, TP: [cluster_name=ISPN] 09:58:52,371 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #182, conn_id=0) 09:58:52,371 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#182 09:58:52,371 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,371 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,371 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,371 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@34d309d2] 09:58:52,371 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,371 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:52,371 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:52,371 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:52,371 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,371 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,371 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:52,371 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,371 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,371 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,371 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90038] on Test-NodeC-52778 09:58:52,371 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #180, conn_id=2) 09:58:52,371 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90038, rsp_expected=true, UNICAST3: DATA, seqno=180, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,371 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,372 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90038, rsp_expected=true, UNICAST3: DATA, seqno=180, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #180, conn_id=2) 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#180 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90038 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37251. timeout=10000 (MILLISECONDS) 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37251. Timeout=10000 (MILLISECONDS) 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37251} 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37251}. Current=null 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37251}) => true 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37251}. WAITING => ACQUIRED 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37251} successfully acquired the lock. 09:58:52,372 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@31d755fc] 09:58:52,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:52,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37251. timeout=10000 (MILLISECONDS) 09:58:52,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37251. Timeout=10000 (MILLISECONDS) 09:58:52,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37251} 09:58:52,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:52,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:52,381 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(44dd58ed){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:52,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90039] on Test-NodeA-7051 09:58:52,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #183, conn_id=0) 09:58:52,382 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90039, rsp_expected=true, UNICAST3: DATA, seqno=183, TP: [cluster_name=ISPN] 09:58:52,382 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,382 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:52,382 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90039, rsp_expected=true, UNICAST3: DATA, seqno=183, TP: [cluster_name=ISPN] 09:58:52,389 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #183, conn_id=0) 09:58:52,389 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#183 09:58:52,394 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90039 09:58:52,397 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:52,397 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,402 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,402 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,402 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,413 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@49b848cf] 09:58:52,413 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,413 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:52,417 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,418 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(395dae4a){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(395dae4a){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,427 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,428 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90039 to Test-NodeC-52778 09:58:52,428 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #181, conn_id=2) 09:58:52,428 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90039, rsp_expected=true, UNICAST3: DATA, seqno=181, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,428 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37251 09:58:52,428 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,430 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:52,431 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90039, rsp_expected=true, UNICAST3: DATA, seqno=181, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,432 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #181, conn_id=2) 09:58:52,433 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#181 09:58:52,433 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,433 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(44dd58ed){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37251 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37251. 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37251}. ACQUIRED => RELEASED 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37251}? true 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37251} 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37251}, null) => true 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90038 to Test-NodeA-7051 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #184, conn_id=0) 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90038, rsp_expected=true, UNICAST3: DATA, seqno=184, TP: [cluster_name=ISPN] 09:58:52,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37251 09:58:52,433 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,433 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,433 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90038, rsp_expected=true, UNICAST3: DATA, seqno=184, TP: [cluster_name=ISPN] 09:58:52,442 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #184, conn_id=0) 09:58:52,444 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#184 09:58:52,450 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,450 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,450 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,457 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1ebd5571] 09:58:52,457 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,457 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:52,457 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:37264. timeout=10000 (MILLISECONDS) 09:58:52,457 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37264. Timeout=10000 (MILLISECONDS) 09:58:52,457 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37264} 09:58:52,458 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37264}. Current=null 09:58:52,458 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37264}) => true 09:58:52,458 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37264}. WAITING => ACQUIRED 09:58:52,458 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37264} successfully acquired the lock. 09:58:52,458 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:52,458 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:52,458 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,458 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,458 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:52,458 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(43b93c0d){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,458 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,458 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,458 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:52,458 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,458 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,458 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:52,458 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90049] on Test-NodeB-10318 09:58:52,458 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #101, conn_id=1) 09:58:52,458 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90049, rsp_expected=true, UNICAST3: DATA, seqno=101, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,458 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,458 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:52,458 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90049, rsp_expected=true, UNICAST3: DATA, seqno=101, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,458 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #101, conn_id=1) 09:58:52,458 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#101 09:58:52,458 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90049 09:58:52,458 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,458 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,458 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,458 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2219927d] 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4c6ad13){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4c6ad13){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90049 to Test-NodeA-7051 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #103, conn_id=0) 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90049, rsp_expected=true, UNICAST3: DATA, seqno=103, TP: [cluster_name=ISPN] 09:58:52,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37264 09:58:52,459 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,459 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,459 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90049, rsp_expected=true, UNICAST3: DATA, seqno=103, TP: [cluster_name=ISPN] 09:58:52,459 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #103, conn_id=0) 09:58:52,459 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#103 09:58:52,459 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,459 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:52,459 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(43b93c0d){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,459 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:52,459 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,460 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,460 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:52,460 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:52,460 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,460 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:37264 09:58:52,460 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37264. 09:58:52,460 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37264}. ACQUIRED => RELEASED 09:58:52,462 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37264}? true 09:58:52,462 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37264} 09:58:52,462 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37264}, null) => true 09:58:52,465 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,465 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3dc8d088] 09:58:52,465 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,465 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:52,465 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:52,465 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:52,465 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,465 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,465 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:52,465 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,465 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,465 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,465 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90050] on Test-NodeC-52778 09:58:52,465 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #182, conn_id=2) 09:58:52,465 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90050, rsp_expected=true, UNICAST3: DATA, seqno=182, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,465 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,465 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:52,465 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90050, rsp_expected=true, UNICAST3: DATA, seqno=182, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #182, conn_id=2) 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#182 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90050 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37265. timeout=10000 (MILLISECONDS) 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37265. Timeout=10000 (MILLISECONDS) 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37265} 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37265}. Current=null 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37265}) => true 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37265}. WAITING => ACQUIRED 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37265} successfully acquired the lock. 09:58:52,466 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2e6b96a6] 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37265. timeout=10000 (MILLISECONDS) 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37265. Timeout=10000 (MILLISECONDS) 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37265} 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7627e57d){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,468 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:52,468 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90051] on Test-NodeA-7051 09:58:52,468 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #185, conn_id=0) 09:58:52,468 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90051, rsp_expected=true, UNICAST3: DATA, seqno=185, TP: [cluster_name=ISPN] 09:58:52,473 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,473 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:52,473 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90051, rsp_expected=true, UNICAST3: DATA, seqno=185, TP: [cluster_name=ISPN] 09:58:52,473 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #185, conn_id=0) 09:58:52,473 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#185 09:58:52,473 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90051 09:58:52,473 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:52,473 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,483 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,483 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,483 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,483 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4b63ab3b] 09:58:52,483 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,483 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:52,483 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,483 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(fe041f0){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(fe041f0){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90051 to Test-NodeC-52778 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #183, conn_id=2) 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90051, rsp_expected=true, UNICAST3: DATA, seqno=183, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,484 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37265 09:58:52,484 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,484 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:52,484 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90051, rsp_expected=true, UNICAST3: DATA, seqno=183, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,484 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #183, conn_id=2) 09:58:52,484 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#183 09:58:52,484 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,503 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7627e57d){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37265 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37265. 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37265}. ACQUIRED => RELEASED 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37265}? true 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37265} 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37265}, null) => true 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90050 to Test-NodeA-7051 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #186, conn_id=0) 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90050, rsp_expected=true, UNICAST3: DATA, seqno=186, TP: [cluster_name=ISPN] 09:58:52,506 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37265 09:58:52,506 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,506 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,507 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90050, rsp_expected=true, UNICAST3: DATA, seqno=186, TP: [cluster_name=ISPN] 09:58:52,507 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #186, conn_id=0) 09:58:52,507 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#186 09:58:52,507 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,507 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,507 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,507 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4ca4f5ae] 09:58:52,507 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,507 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:52,507 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:52,507 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:52,507 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,507 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,507 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:52,507 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,507 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,507 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,507 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90053] on Test-NodeC-52778 09:58:52,507 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #184, conn_id=2) 09:58:52,507 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90053, rsp_expected=true, UNICAST3: DATA, seqno=184, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,507 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,507 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:52,507 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90053, rsp_expected=true, UNICAST3: DATA, seqno=184, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,507 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #184, conn_id=2) 09:58:52,507 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#184 09:58:52,507 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90053 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37268. timeout=10000 (MILLISECONDS) 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37268. Timeout=10000 (MILLISECONDS) 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37268} 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37268}. Current=null 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37268}) => true 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37268}. WAITING => ACQUIRED 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37268} successfully acquired the lock. 09:58:52,508 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1bb9c926] 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37268. timeout=10000 (MILLISECONDS) 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37268. Timeout=10000 (MILLISECONDS) 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37268} 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(78cd6c15){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90054] on Test-NodeA-7051 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #187, conn_id=0) 09:58:52,508 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90054, rsp_expected=true, UNICAST3: DATA, seqno=187, TP: [cluster_name=ISPN] 09:58:52,508 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,508 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:52,509 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90054, rsp_expected=true, UNICAST3: DATA, seqno=187, TP: [cluster_name=ISPN] 09:58:52,509 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #187, conn_id=0) 09:58:52,509 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#187 09:58:52,509 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90054 09:58:52,509 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:52,509 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,509 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4959ef3] 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(506e4fd5){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(506e4fd5){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90054 to Test-NodeC-52778 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #185, conn_id=2) 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90054, rsp_expected=true, UNICAST3: DATA, seqno=185, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,509 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37268 09:58:52,509 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,514 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:52,517 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90054, rsp_expected=true, UNICAST3: DATA, seqno=185, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,517 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #185, conn_id=2) 09:58:52,517 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#185 09:58:52,517 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,517 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:52,517 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(78cd6c15){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,517 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:52,517 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,517 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,517 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:52,517 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37268 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37268. 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37268}. ACQUIRED => RELEASED 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37268}? true 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37268} 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37268}, null) => true 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90053 to Test-NodeA-7051 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #188, conn_id=0) 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90053, rsp_expected=true, UNICAST3: DATA, seqno=188, TP: [cluster_name=ISPN] 09:58:52,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37268 09:58:52,518 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,518 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,518 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90053, rsp_expected=true, UNICAST3: DATA, seqno=188, TP: [cluster_name=ISPN] 09:58:52,518 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #188, conn_id=0) 09:58:52,518 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#188 09:58:52,518 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,518 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,518 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,518 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@64c4a314] 09:58:52,518 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,518 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:52,518 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:52,518 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:52,518 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,518 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,518 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:52,518 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,518 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,518 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:52,519 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90055] on Test-NodeB-10318 09:58:52,519 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #102, conn_id=1) 09:58:52,519 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90055, rsp_expected=true, UNICAST3: DATA, seqno=102, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,521 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,521 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90055, rsp_expected=true, UNICAST3: DATA, seqno=102, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #102, conn_id=1) 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#102 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90055 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37269. timeout=10000 (MILLISECONDS) 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37269. Timeout=10000 (MILLISECONDS) 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37269} 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37269}. Current=null 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37269}) => true 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37269}. WAITING => ACQUIRED 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37269} successfully acquired the lock. 09:58:52,524 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@372571b5] 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37269. timeout=10000 (MILLISECONDS) 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37269. Timeout=10000 (MILLISECONDS) 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37269} 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7fa26580){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90057] on Test-NodeC-52778 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #46, conn_id=1) 09:58:52,525 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90057, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,525 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,525 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:52,526 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90057, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,526 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #46, conn_id=1) 09:58:52,526 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#46 09:58:52,526 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90057 09:58:52,526 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:52,526 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,526 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@52445709] 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(77040379){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(77040379){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,526 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,527 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90057 to Test-NodeB-10318 09:58:52,527 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #46, conn_id=1) 09:58:52,527 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90057, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,527 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37269 09:58:52,527 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,527 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:52,527 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90057, rsp_expected=true, UNICAST3: DATA, seqno=46, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,527 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #46, conn_id=1) 09:58:52,527 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#46 09:58:52,527 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,527 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7fa26580){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37269 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37269. 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37269}. ACQUIRED => RELEASED 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37269}? true 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37269} 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37269}, null) => true 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90055 to Test-NodeA-7051 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #104, conn_id=0) 09:58:52,527 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90055, rsp_expected=true, UNICAST3: DATA, seqno=104, TP: [cluster_name=ISPN] 09:58:52,528 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37269 09:58:52,528 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,528 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,528 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90055, rsp_expected=true, UNICAST3: DATA, seqno=104, TP: [cluster_name=ISPN] 09:58:52,528 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #104, conn_id=0) 09:58:52,528 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#104 09:58:52,528 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,528 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:52,528 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,528 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@bc02bd0] 09:58:52,528 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,528 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:52,528 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:52,528 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:52,528 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,528 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,528 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:52,528 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,528 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,528 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,528 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90058] on Test-NodeC-52778 09:58:52,528 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #186, conn_id=2) 09:58:52,528 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90058, rsp_expected=true, UNICAST3: DATA, seqno=186, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,528 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,528 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90058, rsp_expected=true, UNICAST3: DATA, seqno=186, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #186, conn_id=2) 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#186 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90058 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37270. timeout=10000 (MILLISECONDS) 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37270. Timeout=10000 (MILLISECONDS) 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37270} 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37270}. Current=null 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37270}) => true 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37270}. WAITING => ACQUIRED 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37270} successfully acquired the lock. 09:58:52,529 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3298ef7f] 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37270. timeout=10000 (MILLISECONDS) 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37270. Timeout=10000 (MILLISECONDS) 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37270} 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(66c64322){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:52,530 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90059] on Test-NodeA-7051 09:58:52,530 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #189, conn_id=0) 09:58:52,530 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90059, rsp_expected=true, UNICAST3: DATA, seqno=189, TP: [cluster_name=ISPN] 09:58:52,532 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,532 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:52,532 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90059, rsp_expected=true, UNICAST3: DATA, seqno=189, TP: [cluster_name=ISPN] 09:58:52,532 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #189, conn_id=0) 09:58:52,532 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#189 09:58:52,532 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90059 09:58:52,532 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:52,532 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,532 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,532 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6021c90] 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(b602261){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(b602261){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90059 to Test-NodeC-52778 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #187, conn_id=2) 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90059, rsp_expected=true, UNICAST3: DATA, seqno=187, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,533 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37270 09:58:52,533 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,533 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:52,533 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90059, rsp_expected=true, UNICAST3: DATA, seqno=187, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,533 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #187, conn_id=2) 09:58:52,533 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#187 09:58:52,546 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,546 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:52,547 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(66c64322){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,547 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:52,580 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,580 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,580 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37270 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37270. 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37270}. ACQUIRED => RELEASED 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37270}? true 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37270} 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37270}, null) => true 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90058 to Test-NodeA-7051 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #190, conn_id=0) 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90058, rsp_expected=true, UNICAST3: DATA, seqno=190, TP: [cluster_name=ISPN] 09:58:52,581 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37270 09:58:52,581 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,581 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,598 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #102) 09:58:52,598 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=102, conn_id=1, ts=58, TP: [cluster_name=ISPN] 09:58:52,598 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #46) 09:58:52,598 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,598 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:52,599 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=102, conn_id=1, ts=58, TP: [cluster_name=ISPN] 09:58:52,599 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #102, conn-id=1, ts=58) 09:58:52,598 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=46, conn_id=1, ts=59, TP: [cluster_name=ISPN] 09:58:52,581 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90058, rsp_expected=true, UNICAST3: DATA, seqno=190, TP: [cluster_name=ISPN] 09:58:52,614 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #46) 09:58:52,614 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=46, conn_id=1, ts=60, TP: [cluster_name=ISPN] 09:58:52,614 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #187) 09:58:52,615 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=187, conn_id=2, ts=61, TP: [cluster_name=ISPN] 09:58:52,618 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #104) 09:58:52,618 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=104, ts=68, TP: [cluster_name=ISPN] 09:58:52,618 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #189) 09:58:52,618 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=189, ts=69, TP: [cluster_name=ISPN] 09:58:52,619 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:52,619 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:52,619 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:52,619 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:52,619 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:52,620 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:52,620 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=187, conn_id=2, ts=61, TP: [cluster_name=ISPN] 09:58:52,620 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #187, conn-id=2, ts=61) 09:58:52,612 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:52,621 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=189, ts=69, TP: [cluster_name=ISPN] 09:58:52,621 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #189, conn-id=0, ts=69) 09:58:52,622 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=46, conn_id=1, ts=60, TP: [cluster_name=ISPN] 09:58:52,622 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #46, conn-id=1, ts=60) 09:58:52,622 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=104, ts=68, TP: [cluster_name=ISPN] 09:58:52,632 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #104, conn-id=0, ts=68) 09:58:52,620 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:52,637 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=46, conn_id=1, ts=59, TP: [cluster_name=ISPN] 09:58:52,643 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #46, conn-id=1, ts=59) 09:58:52,642 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #190, conn_id=0) 09:58:52,654 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#190 09:58:52,654 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,654 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,654 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,654 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:52,672 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:52,673 DEBUG (testng-Test:[]) [Test] Found key key-to-change1 with primary owner != Test-NodeA-7051, segment 184 09:58:52,673 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6b381e53] 09:58:52,673 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,673 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:52,673 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:52,673 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:58:52,673 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,673 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,673 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:52,683 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,684 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,684 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:52,684 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90073] on Test-NodeB-10318 09:58:52,684 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #103, conn_id=1) 09:58:52,684 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90073, rsp_expected=true, UNICAST3: DATA, seqno=103, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,684 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,684 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:52,686 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90073, rsp_expected=true, UNICAST3: DATA, seqno=103, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,686 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #103, conn_id=1) 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#103 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90073 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:37290. timeout=10000 (MILLISECONDS) 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37290. Timeout=10000 (MILLISECONDS) 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37290} 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37290}. Current=null 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37290}) => true 09:58:52,694 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37290}. WAITING => ACQUIRED 09:58:52,695 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37290} successfully acquired the lock. 09:58:52,695 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,695 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1d152033] 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:37290. timeout=10000 (MILLISECONDS) 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37290. Timeout=10000 (MILLISECONDS) 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37290} 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4a9fc8bd){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90075] on Test-NodeA-7051 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #105, conn_id=0) 09:58:52,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90075, rsp_expected=true, UNICAST3: DATA, seqno=105, TP: [cluster_name=ISPN] 09:58:52,698 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,698 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (210 bytes) 09:58:52,699 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90075, rsp_expected=true, UNICAST3: DATA, seqno=105, TP: [cluster_name=ISPN] 09:58:52,699 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #105, conn_id=0) 09:58:52,699 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#105 09:58:52,720 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90075 09:58:52,720 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:52,720 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,720 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,720 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,720 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,724 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@23aa47f8] 09:58:52,727 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(118a4bf){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(118a4bf){key=key-to-change1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=initial-value} in container 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90075 to Test-NodeB-10318 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #104, conn_id=1) 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90075, rsp_expected=true, UNICAST3: DATA, seqno=104, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,733 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37290 09:58:52,733 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,737 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:52,739 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90075, rsp_expected=true, UNICAST3: DATA, seqno=104, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,748 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #104, conn_id=1) 09:58:52,748 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#104 09:58:52,748 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,748 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:52,748 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4a9fc8bd){key=key-to-change1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,748 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:52,748 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=initial-value} in container 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:37290 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37290. 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37290}. ACQUIRED => RELEASED 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37290}? true 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37290} 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37290}, null) => true 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90073 to Test-NodeA-7051 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #106, conn_id=0) 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90073, rsp_expected=true, UNICAST3: DATA, seqno=106, TP: [cluster_name=ISPN] 09:58:52,749 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:37290 09:58:52,749 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,749 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,749 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90073, rsp_expected=true, UNICAST3: DATA, seqno=106, TP: [cluster_name=ISPN] 09:58:52,750 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #106, conn_id=0) 09:58:52,750 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#106 09:58:52,750 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,750 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:52,753 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:52,753 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_invoked * 1 09:58:52,753 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:52,762 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id af881726-0c05-4169-b583-7ca02d75a03e 09:58:52,778 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@3da13777[Not completed] to remote execution at node Test-NodeB-10318 09:58:52,778 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6c38cd1c] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,778 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6c38cd1c], mode=SYNCHRONOUS, timeout=15000 09:58:52,778 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6c38cd1c] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:52,778 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90086] on Test-NodeB-10318 09:58:52,778 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #105, conn_id=1) 09:58:52,779 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90086, rsp_expected=true, UNICAST3: DATA, seqno=105, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,779 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@db5dfd7[Not completed] to remote execution at node Test-NodeC-52778 09:58:52,779 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6c38cd1c] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,779 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6c38cd1c], mode=SYNCHRONOUS, timeout=15000 09:58:52,779 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6c38cd1c] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:52,779 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90087] on Test-NodeC-52778 09:58:52,779 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #188, conn_id=2) 09:58:52,779 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90087, rsp_expected=true, UNICAST3: DATA, seqno=188, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,780 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (472 bytes (2360.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:52,834 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:52,834 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90087, rsp_expected=true, UNICAST3: DATA, seqno=188, conn_id=2, TP: [cluster_name=ISPN] 09:58:52,834 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #188, conn_id=2) 09:58:52,834 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:52,837 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90086, rsp_expected=true, UNICAST3: DATA, seqno=105, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,837 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #105, conn_id=1) 09:58:52,837 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#105 09:58:52,841 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90086 09:58:52,841 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3475176b] [sender=Test-NodeA-7051] 09:58:52,841 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:52,841 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,841 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3475176b] 09:58:52,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id af881726-0c05-4169-b583-7ca02d75a03e 09:58:52,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3475176b] 09:58:52,836 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#188 09:58:52,843 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90087 09:58:52,843 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@367f0fb] [sender=Test-NodeA-7051] 09:58:52,843 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:52,843 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@367f0fb] 09:58:52,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id af881726-0c05-4169-b583-7ca02d75a03e 09:58:52,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@367f0fb] 09:58:52,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90087 to Test-NodeA-7051 09:58:52,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #191, conn_id=0) 09:58:52,843 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90087, rsp_expected=true, UNICAST3: DATA, seqno=191, TP: [cluster_name=ISPN] 09:58:52,843 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,843 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,845 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90087, rsp_expected=true, UNICAST3: DATA, seqno=191, TP: [cluster_name=ISPN] 09:58:52,845 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #191, conn_id=0) 09:58:52,845 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#191 09:58:52,845 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,845 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6c38cd1c] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:52,842 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90086 to Test-NodeA-7051 09:58:52,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #107, conn_id=0) 09:58:52,845 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90086, rsp_expected=true, UNICAST3: DATA, seqno=107, TP: [cluster_name=ISPN] 09:58:52,857 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,857 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:52,858 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90086, rsp_expected=true, UNICAST3: DATA, seqno=107, TP: [cluster_name=ISPN] 09:58:52,858 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #107, conn_id=0) 09:58:52,858 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#107 09:58:52,858 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:52,858 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@6c38cd1c] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:52,858 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener af881726-0c05-4169-b583-7ca02d75a03e requests initial state for cache 09:58:52,862 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@1f62a831] 09:58:52,862 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:52,864 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_invoked * 1 (available = 1, total = 1) 09:58:52,864 TRACE (testng-Test:[]) [CheckPoint] Received event pre_retrieve_entry_invoked * 1 (available = 0, total = 1) 09:58:52,864 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_released * 1 09:58:52,870 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3b36be16] 09:58:52,870 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:52,870 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:52,870 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:52,870 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:58:52,870 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,870 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,870 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:52,870 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,870 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,870 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:52,870 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90094] on Test-NodeB-10318 09:58:52,870 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #106, conn_id=1) 09:58:52,870 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90094, rsp_expected=true, UNICAST3: DATA, seqno=106, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,871 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,871 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:52,871 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90094, rsp_expected=true, UNICAST3: DATA, seqno=106, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,876 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #106, conn_id=1) 09:58:52,882 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#106 09:58:52,882 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90094 09:58:52,882 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:37347. timeout=10000 (MILLISECONDS) 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37347. Timeout=10000 (MILLISECONDS) 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37347} 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37347}. Current=null 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37347}) => true 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37347}. WAITING => ACQUIRED 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37347} successfully acquired the lock. 09:58:52,885 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,885 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,885 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,885 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@369ae811] 09:58:52,885 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,885 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:58:52,885 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:37347. timeout=10000 (MILLISECONDS) 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37347. Timeout=10000 (MILLISECONDS) 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37347} 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(44fc0809){key=key-to-change1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:52,899 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,913 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,913 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:52,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:52,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90103] on Test-NodeA-7051 09:58:52,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #108, conn_id=0) 09:58:52,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90103, rsp_expected=true, UNICAST3: DATA, seqno=108, TP: [cluster_name=ISPN] 09:58:52,919 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,919 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (210 bytes) 09:58:52,919 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90103, rsp_expected=true, UNICAST3: DATA, seqno=108, TP: [cluster_name=ISPN] 09:58:52,920 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #108, conn_id=0) 09:58:52,920 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#108 09:58:52,920 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90103 09:58:52,920 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:52,920 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:52,920 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,920 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,920 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:52,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1768de90] 09:58:52,938 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:52,938 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:52,938 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:52,938 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:52,938 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:52,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:52,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:52,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1d119536){key=key-to-change1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:52,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:52,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1d119536){key=key-to-change1, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change1, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=changed-value} in container 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90103 to Test-NodeB-10318 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #107, conn_id=1) 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90103, rsp_expected=true, UNICAST3: DATA, seqno=107, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37347 09:58:52,940 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:52,940 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (96 bytes) 09:58:52,942 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90103, rsp_expected=true, UNICAST3: DATA, seqno=107, conn_id=1, TP: [cluster_name=ISPN] 09:58:52,942 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #107, conn_id=1) 09:58:52,942 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#107 09:58:52,942 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:52,944 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=initial-value} } 09:58:52,944 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(44fc0809){key=key-to-change1, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:52,944 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:52,944 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:52,944 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:52,946 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change1, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:52,947 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=changed-value} in container 09:58:52,948 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_MODIFIED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, key=key-to-change1, value=changed-value, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:58:52,949 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@21383ee3[Not completed] to remote execution at node Test-NodeA-7051 09:58:52,957 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@7f90d424] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:52,957 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@7f90d424], mode=SYNCHRONOUS, timeout=15000 09:58:52,957 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@7f90d424] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:52,957 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90108] on Test-NodeA-7051 09:58:52,957 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #109, conn_id=0) 09:58:52,957 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90108, rsp_expected=true, UNICAST3: DATA, seqno=109, TP: [cluster_name=ISPN] 09:58:52,957 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (378 bytes (1890.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:52,957 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (381 bytes) 09:58:52,957 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=304 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90108, rsp_expected=true, UNICAST3: DATA, seqno=109, TP: [cluster_name=ISPN] 09:58:52,958 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #109, conn_id=0) 09:58:52,958 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#109 09:58:52,958 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90108 09:58:52,958 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3c43a883] [sender=Test-NodeB-10318] 09:58:52,958 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:52,958 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:52,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3c43a883] 09:58:52,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_MODIFIED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=changed-value, oldValue=null, transaction=null, retryCommand=false, origin=Test-NodeB-10318}], notifying cluster listener with id af881726-0c05-4169-b583-7ca02d75a03e 09:58:52,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@3c43a883] 09:58:52,997 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90108 to Test-NodeB-10318 09:58:52,998 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #108, conn_id=1) 09:58:52,998 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90108, rsp_expected=true, UNICAST3: DATA, seqno=108, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,000 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,001 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:53,002 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90108, rsp_expected=true, UNICAST3: DATA, seqno=108, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,002 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #108, conn_id=1) 09:58:53,002 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#108 09:58:53,002 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,002 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@7f90d424] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:53,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:53,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:37347 09:58:53,003 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37347. 09:58:53,003 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37347}. ACQUIRED => RELEASED 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37347}? true 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37347} 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37347}, null) => true 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90094 to Test-NodeA-7051 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #110, conn_id=0) 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90094, rsp_expected=true, UNICAST3: DATA, seqno=110, TP: [cluster_name=ISPN] 09:58:53,004 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:37347 09:58:53,004 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,009 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:58:53,009 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90094, rsp_expected=true, UNICAST3: DATA, seqno=110, TP: [cluster_name=ISPN] 09:58:53,015 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #110, conn_id=0) 09:58:53,016 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#110 09:58:53,018 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:53,018 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:58:53,019 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:53,022 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_released * 999999999 (available = 999999999, total = 999999999) 09:58:53,024 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_retrieve_entry_released * 1 (available = 999999998, total = 999999999) 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705110 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705110 excluding keys [] 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90116] on Test-NodeB-10318 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #109, conn_id=1) 09:58:53,025 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90116, rsp_expected=true, UNICAST3: DATA, seqno=109, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,025 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,028 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:58:53,028 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90116, rsp_expected=true, UNICAST3: DATA, seqno=109, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,030 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #109, conn_id=1) 09:58:53,032 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#109 09:58:53,032 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90116 09:58:53,032 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:53,032 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,034 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,034 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:53,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705110 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:53,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@4a6e9cc5] 09:58:53,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:53,039 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705110 09:58:53,040 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705110 09:58:53,040 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705110 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705110 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705110 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90124] on Test-NodeA-7051 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #111, conn_id=0) 09:58:53,041 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90124, rsp_expected=true, UNICAST3: DATA, seqno=111, TP: [cluster_name=ISPN] 09:58:53,041 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (258 bytes (1290.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,041 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (261 bytes) 09:58:53,041 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=184 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90124, rsp_expected=true, UNICAST3: DATA, seqno=111, TP: [cluster_name=ISPN] 09:58:53,042 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #111, conn_id=0) 09:58:53,043 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#111 09:58:53,044 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90124 09:58:53,045 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:53,046 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:53,047 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:53,047 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705110 with [] suspected segments. 09:58:53,047 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,047 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:53,048 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 3 09:58:53,050 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:53,051 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90124 to Test-NodeB-10318 09:58:53,053 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #110, conn_id=1) 09:58:53,053 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90124, rsp_expected=true, UNICAST3: DATA, seqno=110, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,057 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,057 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:53,063 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90124, rsp_expected=true, UNICAST3: DATA, seqno=110, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,067 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #110, conn_id=1) 09:58:53,067 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#110 09:58:53,068 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:53,068 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:53,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:53,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90116 to Test-NodeA-7051 09:58:53,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #112, conn_id=0) 09:58:53,069 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90116, rsp_expected=true, UNICAST3: DATA, seqno=112, TP: [cluster_name=ISPN] 09:58:53,071 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,074 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:53,075 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90116, rsp_expected=true, UNICAST3: DATA, seqno=112, TP: [cluster_name=ISPN] 09:58:53,075 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #112, conn_id=0) 09:58:53,075 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#112 09:58:53,075 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:53,075 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:53,075 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705110 excluding keys [] 09:58:53,077 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,077 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:53,078 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:53,078 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,078 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90134] on Test-NodeC-52778 09:58:53,078 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #189, conn_id=2) 09:58:53,078 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90134, rsp_expected=true, UNICAST3: DATA, seqno=189, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,078 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (607 bytes (3035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,079 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (610 bytes) 09:58:53,079 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90134, rsp_expected=true, UNICAST3: DATA, seqno=189, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,079 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #189, conn_id=2) 09:58:53,079 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#189 09:58:53,079 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90134 09:58:53,080 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:53,080 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,080 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,080 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:53,081 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705110 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:53,081 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@71f5f124] 09:58:53,082 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:53,083 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705110 09:58:53,083 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705110 09:58:53,083 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705110 09:58:53,084 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:53,084 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705110 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:53,085 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705110 09:58:53,085 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:53,086 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:53,088 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90136] on Test-NodeA-7051 09:58:53,088 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #192, conn_id=0) 09:58:53,088 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90136, rsp_expected=true, UNICAST3: DATA, seqno=192, TP: [cluster_name=ISPN] 09:58:53,090 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (315 bytes (1575.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,090 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (318 bytes) 09:58:53,090 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=241 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90136, rsp_expected=true, UNICAST3: DATA, seqno=192, TP: [cluster_name=ISPN] 09:58:53,092 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #192, conn_id=0) 09:58:53,093 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#192 09:58:53,095 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90136 09:58:53,095 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:53,095 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:53,096 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:53,096 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705110 with [] suspected segments. 09:58:53,096 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:53,095 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,096 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:53,097 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705110 as completed! 09:58:53,097 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:53,098 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90136 to Test-NodeC-52778 09:58:53,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #190, conn_id=2) 09:58:53,100 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90136, rsp_expected=true, UNICAST3: DATA, seqno=190, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,100 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,100 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:53,101 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90136, rsp_expected=true, UNICAST3: DATA, seqno=190, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,101 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #190, conn_id=2) 09:58:53,101 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#190 09:58:53,104 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:53,105 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:53,106 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:53,106 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90134 to Test-NodeA-7051 09:58:53,106 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #193, conn_id=0) 09:58:53,106 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90134, rsp_expected=true, UNICAST3: DATA, seqno=193, TP: [cluster_name=ISPN] 09:58:53,106 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,108 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:53,108 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90134, rsp_expected=true, UNICAST3: DATA, seqno=193, TP: [cluster_name=ISPN] 09:58:53,108 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #193, conn_id=0) 09:58:53,108 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#193 09:58:53,108 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:53,108 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,108 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:53,108 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-705110 09:58:53,108 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:53,109 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:53,109 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705110 09:58:53,110 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705110 being completed: true 09:58:53,112 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #110) 09:58:53,112 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=110, conn_id=1, ts=60, TP: [cluster_name=ISPN] 09:58:53,112 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705110 09:58:53,112 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,112 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,118 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:53,113 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:53,119 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=110, conn_id=1, ts=60, TP: [cluster_name=ISPN] 09:58:53,119 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #110, conn-id=1, ts=60) 09:58:53,119 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #112) 09:58:53,119 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:53,115 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #190) 09:58:53,120 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=190, conn_id=2, ts=62, TP: [cluster_name=ISPN] 09:58:53,119 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:53,121 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:53,121 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:53,121 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=112, ts=70, TP: [cluster_name=ISPN] 09:58:53,121 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #193) 09:58:53,121 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=193, ts=71, TP: [cluster_name=ISPN] 09:58:53,121 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,121 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:53,121 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,121 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=112, ts=70, TP: [cluster_name=ISPN] 09:58:53,121 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #112, conn-id=0, ts=70) 09:58:53,121 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:53,124 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,121 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:53,125 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=193, ts=71, TP: [cluster_name=ISPN] 09:58:53,125 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #193, conn-id=0, ts=71) 09:58:53,124 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:53,124 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:53,127 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=190, conn_id=2, ts=62, TP: [cluster_name=ISPN] 09:58:53,127 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #190, conn-id=2, ts=62) 09:58:53,128 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:53,128 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:53,129 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:53,129 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:53,129 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:53,130 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:53,130 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:53,130 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:53,130 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:53,130 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:53,130 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:53,130 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:53,130 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:53,132 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:53,134 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:53,134 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:53,134 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:53,134 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:53,134 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:53,134 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:53,134 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:53,137 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:53,137 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:53,162 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:53,178 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:53,181 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:53,181 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:53,184 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:53,189 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:53,189 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:53,189 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:53,189 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:53,189 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:53,189 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:53,189 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:53,189 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:53,194 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:53,195 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:53,195 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:53,197 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=changed-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:53,198 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:53,198 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:53,198 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener af881726-0c05-4169-b583-7ca02d75a03e initial state for cache completed 09:58:53,198 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:53,199 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@2d017c67[Not completed] to self 09:58:53,200 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@6421d0da[Not completed] to remote execution at node Test-NodeB-10318 09:58:53,201 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6ac81f92] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,201 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6ac81f92], mode=SYNCHRONOUS, timeout=15000 09:58:53,201 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6ac81f92] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:53,202 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90155] on Test-NodeB-10318 09:58:53,205 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #111, conn_id=1) 09:58:53,205 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90155, rsp_expected=true, UNICAST3: DATA, seqno=111, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,205 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,205 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@6f79e960[Not completed] to remote execution at node Test-NodeC-52778 09:58:53,205 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6ac81f92] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,211 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6ac81f92], mode=SYNCHRONOUS, timeout=15000 09:58:53,205 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:53,211 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6ac81f92] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,212 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90159] on Test-NodeC-52778 09:58:53,212 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #191, conn_id=2) 09:58:53,212 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90159, rsp_expected=true, UNICAST3: DATA, seqno=191, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,213 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90155, rsp_expected=true, UNICAST3: DATA, seqno=111, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,216 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,216 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:53,217 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90159, rsp_expected=true, UNICAST3: DATA, seqno=191, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,217 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #191, conn_id=2) 09:58:53,217 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#191 09:58:53,217 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90159 09:58:53,217 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2c35fde3] [sender=Test-NodeA-7051] 09:58:53,217 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:53,217 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,217 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2c35fde3] 09:58:53,217 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : af881726-0c05-4169-b583-7ca02d75a03e 09:58:53,217 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@2c35fde3] 09:58:53,217 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90159 to Test-NodeA-7051 09:58:53,217 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #194, conn_id=0) 09:58:53,217 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90159, rsp_expected=true, UNICAST3: DATA, seqno=194, TP: [cluster_name=ISPN] 09:58:53,217 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,217 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,218 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90159, rsp_expected=true, UNICAST3: DATA, seqno=194, TP: [cluster_name=ISPN] 09:58:53,218 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #194, conn_id=0) 09:58:53,218 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#194 09:58:53,218 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,218 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6ac81f92] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,215 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #111, conn_id=1) 09:58:53,226 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#111 09:58:53,226 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90155 09:58:53,227 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3b64bbc0] [sender=Test-NodeA-7051] 09:58:53,227 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:53,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3b64bbc0] 09:58:53,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : af881726-0c05-4169-b583-7ca02d75a03e 09:58:53,229 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,229 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@3b64bbc0] 09:58:53,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90155 to Test-NodeA-7051 09:58:53,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #113, conn_id=0) 09:58:53,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90155, rsp_expected=true, UNICAST3: DATA, seqno=113, TP: [cluster_name=ISPN] 09:58:53,232 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,232 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,232 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90155, rsp_expected=true, UNICAST3: DATA, seqno=113, TP: [cluster_name=ISPN] 09:58:53,232 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #113, conn_id=0) 09:58:53,233 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#113 09:58:53,233 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,233 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6ac81f92] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:53,233 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:53,234 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:53,236 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganButNotIteratedValueYetNonOwnerClustered 09:58:53,237 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:53,237 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:53,237 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:53,237 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:53,238 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:53,241 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:53,241 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:53,241 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:53,241 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:53,241 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:53,241 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:53,241 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:53,242 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:53,242 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:53,242 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganButNotIteratedValueYetOwnerClustered 09:58:53,242 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5fa7cea9] 09:58:53,242 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,242 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:53,242 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:53,242 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:53,242 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,242 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,242 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:53,242 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,242 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,242 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:53,243 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90163] on Test-NodeB-10318 09:58:53,243 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #112, conn_id=1) 09:58:53,243 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90163, rsp_expected=true, UNICAST3: DATA, seqno=112, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,243 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,243 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:53,244 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90163, rsp_expected=true, UNICAST3: DATA, seqno=112, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,244 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #112, conn_id=1) 09:58:53,245 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#112 09:58:53,255 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90163 09:58:53,255 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,256 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,263 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37375. timeout=10000 (MILLISECONDS) 09:58:53,267 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37375. Timeout=10000 (MILLISECONDS) 09:58:53,267 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37375} 09:58:53,267 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37375}. Current=null 09:58:53,267 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37375}) => true 09:58:53,267 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37375}. WAITING => ACQUIRED 09:58:53,267 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37375} successfully acquired the lock. 09:58:53,268 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@179d0b73] 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37375. timeout=10000 (MILLISECONDS) 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37375. Timeout=10000 (MILLISECONDS) 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37375} 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(60802506){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90167] on Test-NodeC-52778 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #47, conn_id=1) 09:58:53,268 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90167, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,268 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,268 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,269 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90167, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,269 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #47, conn_id=1) 09:58:53,269 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#47 09:58:53,269 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90167 09:58:53,269 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:53,269 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,269 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4edd5c76] 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6eb0e2e){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6eb0e2e){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90167 to Test-NodeB-10318 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #47, conn_id=1) 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90167, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,269 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37375 09:58:53,269 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,270 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:53,270 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90167, rsp_expected=true, UNICAST3: DATA, seqno=47, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,270 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #47, conn_id=1) 09:58:53,270 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#47 09:58:53,272 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,272 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(60802506){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37375 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37375. 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37375}. ACQUIRED => RELEASED 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37375}? true 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37375} 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37375}, null) => true 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90163 to Test-NodeA-7051 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #114, conn_id=0) 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90163, rsp_expected=true, UNICAST3: DATA, seqno=114, TP: [cluster_name=ISPN] 09:58:53,273 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37375 09:58:53,273 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,273 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,273 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90163, rsp_expected=true, UNICAST3: DATA, seqno=114, TP: [cluster_name=ISPN] 09:58:53,273 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #114, conn_id=0) 09:58:53,273 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#114 09:58:53,273 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,273 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:53,274 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,274 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7c200e03] 09:58:53,275 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,275 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:53,275 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:53,276 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:53,276 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,276 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,276 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:53,276 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,276 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,276 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,276 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90168] on Test-NodeC-52778 09:58:53,276 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #192, conn_id=2) 09:58:53,276 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90168, rsp_expected=true, UNICAST3: DATA, seqno=192, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,277 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,277 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,277 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90168, rsp_expected=true, UNICAST3: DATA, seqno=192, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,277 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #192, conn_id=2) 09:58:53,277 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#192 09:58:53,277 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90168 09:58:53,277 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,277 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,279 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37378. timeout=10000 (MILLISECONDS) 09:58:53,279 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37378. Timeout=10000 (MILLISECONDS) 09:58:53,280 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37378} 09:58:53,280 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37378}. Current=null 09:58:53,280 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37378}) => true 09:58:53,280 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37378}. WAITING => ACQUIRED 09:58:53,280 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37378} successfully acquired the lock. 09:58:53,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3f78b8b5] 09:58:53,283 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,283 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:53,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37378. timeout=10000 (MILLISECONDS) 09:58:53,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37378. Timeout=10000 (MILLISECONDS) 09:58:53,288 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37378} 09:58:53,288 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,288 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:53,288 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,293 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,294 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:53,300 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6ca94745){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,300 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,301 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,301 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,309 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,309 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:53,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90176] on Test-NodeA-7051 09:58:53,317 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #195, conn_id=0) 09:58:53,320 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90176, rsp_expected=true, UNICAST3: DATA, seqno=195, TP: [cluster_name=ISPN] 09:58:53,320 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,330 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:53,330 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90176, rsp_expected=true, UNICAST3: DATA, seqno=195, TP: [cluster_name=ISPN] 09:58:53,330 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #195, conn_id=0) 09:58:53,330 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#195 09:58:53,330 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90176 09:58:53,330 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:53,331 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,331 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,331 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,331 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,331 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@287aae58] 09:58:53,331 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,331 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:53,331 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,331 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(67fd3b19){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(67fd3b19){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:53,333 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90176 to Test-NodeC-52778 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #193, conn_id=2) 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90176, rsp_expected=true, UNICAST3: DATA, seqno=193, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,334 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37378 09:58:53,334 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,334 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:53,334 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90176, rsp_expected=true, UNICAST3: DATA, seqno=193, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,336 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #193, conn_id=2) 09:58:53,337 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#193 09:58:53,337 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,337 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:53,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6ca94745){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:53,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,338 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,338 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:53,339 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:53,341 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,342 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37378 09:58:53,342 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37378. 09:58:53,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37378}. ACQUIRED => RELEASED 09:58:53,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37378}? true 09:58:53,343 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37378} 09:58:53,344 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37378}, null) => true 09:58:53,344 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90168 to Test-NodeA-7051 09:58:53,350 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #196, conn_id=0) 09:58:53,350 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90168, rsp_expected=true, UNICAST3: DATA, seqno=196, TP: [cluster_name=ISPN] 09:58:53,350 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,350 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37378 09:58:53,361 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,362 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90168, rsp_expected=true, UNICAST3: DATA, seqno=196, TP: [cluster_name=ISPN] 09:58:53,363 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #196, conn_id=0) 09:58:53,363 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#196 09:58:53,364 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,364 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,365 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,367 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7f3e5f95] 09:58:53,368 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,371 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:53,371 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:53,373 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:53,374 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,374 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,374 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:53,374 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,374 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,374 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,374 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90189] on Test-NodeC-52778 09:58:53,374 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #194, conn_id=2) 09:58:53,374 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90189, rsp_expected=true, UNICAST3: DATA, seqno=194, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,374 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,374 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,375 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90189, rsp_expected=true, UNICAST3: DATA, seqno=194, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,375 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #194, conn_id=2) 09:58:53,375 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#194 09:58:53,376 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90189 09:58:53,376 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,376 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,376 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37386. timeout=10000 (MILLISECONDS) 09:58:53,376 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37386. Timeout=10000 (MILLISECONDS) 09:58:53,381 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37386} 09:58:53,382 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37386}. Current=null 09:58:53,382 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37386}) => true 09:58:53,383 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37386}. WAITING => ACQUIRED 09:58:53,383 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37386} successfully acquired the lock. 09:58:53,383 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,383 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,383 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,386 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@335252c4] 09:58:53,387 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,388 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:53,389 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37386. timeout=10000 (MILLISECONDS) 09:58:53,389 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37386. Timeout=10000 (MILLISECONDS) 09:58:53,389 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37386} 09:58:53,390 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,390 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:53,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,393 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,395 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:53,396 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(59db452b){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,397 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:53,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90201] on Test-NodeB-10318 09:58:53,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #48, conn_id=1) 09:58:53,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90201, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,401 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,401 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:53,401 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90201, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,401 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #48, conn_id=1) 09:58:53,401 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#48 09:58:53,401 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90201 09:58:53,401 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:53,401 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,401 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2c6184fb] 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6bb509a2){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6bb509a2){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,401 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90201 to Test-NodeC-52778 09:58:53,402 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #48, conn_id=1) 09:58:53,402 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90201, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,402 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37386 09:58:53,402 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,402 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:53,402 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90201, rsp_expected=true, UNICAST3: DATA, seqno=48, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,402 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #48, conn_id=1) 09:58:53,402 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#48 09:58:53,402 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,402 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(59db452b){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37386 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37386. 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37386}. ACQUIRED => RELEASED 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37386}? true 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37386} 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37386}, null) => true 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90189 to Test-NodeA-7051 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #197, conn_id=0) 09:58:53,402 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90189, rsp_expected=true, UNICAST3: DATA, seqno=197, TP: [cluster_name=ISPN] 09:58:53,403 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37386 09:58:53,403 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,403 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,403 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90189, rsp_expected=true, UNICAST3: DATA, seqno=197, TP: [cluster_name=ISPN] 09:58:53,403 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #197, conn_id=0) 09:58:53,403 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#197 09:58:53,403 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,403 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,403 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,403 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@457df278] 09:58:53,403 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,403 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:53,403 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:53,403 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:53,403 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,403 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,403 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:53,403 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,403 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,403 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,403 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90202] on Test-NodeC-52778 09:58:53,404 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #195, conn_id=2) 09:58:53,404 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90202, rsp_expected=true, UNICAST3: DATA, seqno=195, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,404 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,404 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,407 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90202, rsp_expected=true, UNICAST3: DATA, seqno=195, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,410 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #195, conn_id=2) 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#195 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90202 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37391. timeout=10000 (MILLISECONDS) 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37391. Timeout=10000 (MILLISECONDS) 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37391} 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37391}. Current=null 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37391}) => true 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37391}. WAITING => ACQUIRED 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37391} successfully acquired the lock. 09:58:53,414 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,414 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,418 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,418 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@d188db6] 09:58:53,418 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,422 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:53,422 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37391. timeout=10000 (MILLISECONDS) 09:58:53,422 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37391. Timeout=10000 (MILLISECONDS) 09:58:53,422 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37391} 09:58:53,423 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,423 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:53,424 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,426 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,427 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:53,427 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2f9e90b5){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,427 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,427 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,428 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,428 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,429 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:53,430 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90208] on Test-NodeB-10318 09:58:53,430 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #49, conn_id=1) 09:58:53,475 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90208, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,475 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,475 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:53,477 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90208, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,480 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #49, conn_id=1) 09:58:53,480 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#49 09:58:53,482 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90208 09:58:53,483 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:53,484 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,556 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,558 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@40e963] 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:53,566 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(711a97f9){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,570 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(711a97f9){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:53,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:53,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:53,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,580 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90208 to Test-NodeC-52778 09:58:53,588 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #49, conn_id=1) 09:58:53,588 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90208, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,588 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37391 09:58:53,588 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,590 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:53,596 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90208, rsp_expected=true, UNICAST3: DATA, seqno=49, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,597 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #49, conn_id=1) 09:58:53,597 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#49 09:58:53,598 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,598 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2f9e90b5){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37391 09:58:53,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37391. 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37391}. ACQUIRED => RELEASED 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37391}? true 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37391} 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37391}, null) => true 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90202 to Test-NodeA-7051 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #198, conn_id=0) 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90202, rsp_expected=true, UNICAST3: DATA, seqno=198, TP: [cluster_name=ISPN] 09:58:53,599 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37391 09:58:53,599 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,599 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,599 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90202, rsp_expected=true, UNICAST3: DATA, seqno=198, TP: [cluster_name=ISPN] 09:58:53,599 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #198, conn_id=0) 09:58:53,599 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#198 09:58:53,603 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,603 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,605 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,606 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@31b938b9] 09:58:53,606 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,606 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:53,606 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:53,606 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:53,606 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,606 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,606 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:53,606 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,606 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,606 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,606 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90226] on Test-NodeC-52778 09:58:53,606 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #196, conn_id=2) 09:58:53,606 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90226, rsp_expected=true, UNICAST3: DATA, seqno=196, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,606 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,606 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,612 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90226, rsp_expected=true, UNICAST3: DATA, seqno=196, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,612 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #196, conn_id=2) 09:58:53,613 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#196 09:58:53,613 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90226 09:58:53,612 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #112) 09:58:53,613 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=112, conn_id=1, ts=61, TP: [cluster_name=ISPN] 09:58:53,613 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,617 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,614 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,614 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #49) 09:58:53,618 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:53,617 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37400. timeout=10000 (MILLISECONDS) 09:58:53,618 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=112, conn_id=1, ts=61, TP: [cluster_name=ISPN] 09:58:53,618 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=49, conn_id=1, ts=62, TP: [cluster_name=ISPN] 09:58:53,620 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,620 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:53,620 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=49, conn_id=1, ts=62, TP: [cluster_name=ISPN] 09:58:53,620 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #49, conn-id=1, ts=62) 09:58:53,620 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #112, conn-id=1, ts=61) 09:58:53,619 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37400. Timeout=10000 (MILLISECONDS) 09:58:53,621 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #114) 09:58:53,621 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=114, ts=72, TP: [cluster_name=ISPN] 09:58:53,623 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #198) 09:58:53,624 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #49) 09:58:53,621 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37400} 09:58:53,624 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=49, conn_id=1, ts=63, TP: [cluster_name=ISPN] 09:58:53,623 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=198, ts=73, TP: [cluster_name=ISPN] 09:58:53,623 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,624 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:53,624 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,626 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:53,624 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #196) 09:58:53,626 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=196, conn_id=2, ts=64, TP: [cluster_name=ISPN] 09:58:53,626 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,626 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:53,626 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=49, conn_id=1, ts=63, TP: [cluster_name=ISPN] 09:58:53,626 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #49, conn-id=1, ts=63) 09:58:53,624 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37400}. Current=null 09:58:53,626 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=196, conn_id=2, ts=64, TP: [cluster_name=ISPN] 09:58:53,627 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #196, conn-id=2, ts=64) 09:58:53,628 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=114, ts=72, TP: [cluster_name=ISPN] 09:58:53,628 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #114, conn-id=0, ts=72) 09:58:53,628 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,629 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:53,628 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37400}) => true 09:58:53,629 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37400}. WAITING => ACQUIRED 09:58:53,629 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=198, ts=73, TP: [cluster_name=ISPN] 09:58:53,631 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #198, conn-id=0, ts=73) 09:58:53,629 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37400} successfully acquired the lock. 09:58:53,633 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,633 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,633 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,633 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@55ec83ec] 09:58:53,633 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:53,634 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37400. timeout=10000 (MILLISECONDS) 09:58:53,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37400. Timeout=10000 (MILLISECONDS) 09:58:53,637 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37400} 09:58:53,637 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6060fe83){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90230] on Test-NodeA-7051 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #199, conn_id=0) 09:58:53,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90230, rsp_expected=true, UNICAST3: DATA, seqno=199, TP: [cluster_name=ISPN] 09:58:53,643 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,643 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:53,643 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90230, rsp_expected=true, UNICAST3: DATA, seqno=199, TP: [cluster_name=ISPN] 09:58:53,643 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #199, conn_id=0) 09:58:53,644 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#199 09:58:53,645 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90230 09:58:53,646 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:53,647 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,648 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,649 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,649 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,649 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@17366b58] 09:58:53,650 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,651 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:53,653 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,653 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:53,653 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,655 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,656 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:53,656 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3a98c7e1){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,656 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,657 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,657 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3a98c7e1){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,658 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:53,659 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:53,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:53,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,662 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90230 to Test-NodeC-52778 09:58:53,663 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #197, conn_id=2) 09:58:53,663 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90230, rsp_expected=true, UNICAST3: DATA, seqno=197, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,663 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37400 09:58:53,663 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,663 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:53,663 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90230, rsp_expected=true, UNICAST3: DATA, seqno=197, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,664 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #197, conn_id=2) 09:58:53,664 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#197 09:58:53,664 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,665 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:53,665 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6060fe83){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,666 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:53,666 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,667 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,667 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:53,670 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37400 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37400. 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37400}. ACQUIRED => RELEASED 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37400}? true 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37400} 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37400}, null) => true 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90226 to Test-NodeA-7051 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #200, conn_id=0) 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90226, rsp_expected=true, UNICAST3: DATA, seqno=200, TP: [cluster_name=ISPN] 09:58:53,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37400 09:58:53,675 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,675 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,675 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90226, rsp_expected=true, UNICAST3: DATA, seqno=200, TP: [cluster_name=ISPN] 09:58:53,675 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #200, conn_id=0) 09:58:53,675 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#200 09:58:53,675 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,675 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,675 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,675 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@38ebd869] 09:58:53,677 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,677 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:53,679 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:37409. timeout=10000 (MILLISECONDS) 09:58:53,680 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37409. Timeout=10000 (MILLISECONDS) 09:58:53,681 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37409} 09:58:53,682 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37409}. Current=null 09:58:53,683 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37409}) => true 09:58:53,684 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37409}. WAITING => ACQUIRED 09:58:53,684 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37409} successfully acquired the lock. 09:58:53,684 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:53,684 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:53,684 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,684 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,684 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:53,684 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(38bd239f){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,684 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,685 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,685 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:53,685 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,685 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,685 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:53,685 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90247] on Test-NodeB-10318 09:58:53,685 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #113, conn_id=1) 09:58:53,685 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90247, rsp_expected=true, UNICAST3: DATA, seqno=113, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,685 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,687 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:53,688 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90247, rsp_expected=true, UNICAST3: DATA, seqno=113, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,688 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #113, conn_id=1) 09:58:53,688 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#113 09:58:53,688 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90247 09:58:53,688 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,688 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,688 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,688 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,688 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,688 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@517c937d] 09:58:53,688 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,688 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(124768e9){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,690 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(124768e9){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,694 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:53,694 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,694 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,695 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:53,695 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:53,697 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,698 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,699 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90247 to Test-NodeA-7051 09:58:53,699 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #115, conn_id=0) 09:58:53,699 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90247, rsp_expected=true, UNICAST3: DATA, seqno=115, TP: [cluster_name=ISPN] 09:58:53,700 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,700 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37409 09:58:53,701 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90247, rsp_expected=true, UNICAST3: DATA, seqno=115, TP: [cluster_name=ISPN] 09:58:53,706 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #115, conn_id=0) 09:58:53,706 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#115 09:58:53,708 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,709 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:53,710 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(38bd239f){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,710 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:53,710 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,711 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,716 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:53,717 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:53,717 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,717 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:37409 09:58:53,717 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37409. 09:58:53,718 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37409}. ACQUIRED => RELEASED 09:58:53,718 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37409}? true 09:58:53,718 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37409} 09:58:53,718 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37409}, null) => true 09:58:53,718 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,718 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3a4fc3eb] 09:58:53,718 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,718 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:53,718 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:53,718 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:53,718 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,718 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,718 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:53,718 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,718 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,718 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,718 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90256] on Test-NodeC-52778 09:58:53,718 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #198, conn_id=2) 09:58:53,718 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90256, rsp_expected=true, UNICAST3: DATA, seqno=198, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,718 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,718 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,719 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90256, rsp_expected=true, UNICAST3: DATA, seqno=198, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,719 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #198, conn_id=2) 09:58:53,720 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#198 09:58:53,720 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90256 09:58:53,720 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,721 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,721 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37412. timeout=10000 (MILLISECONDS) 09:58:53,721 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37412. Timeout=10000 (MILLISECONDS) 09:58:53,725 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37412} 09:58:53,725 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37412}. Current=null 09:58:53,725 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37412}) => true 09:58:53,725 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37412}. WAITING => ACQUIRED 09:58:53,725 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37412} successfully acquired the lock. 09:58:53,730 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,730 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,731 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,731 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4ed63ca] 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37412. timeout=10000 (MILLISECONDS) 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37412. Timeout=10000 (MILLISECONDS) 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37412} 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3fbfb43d){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90258] on Test-NodeA-7051 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #201, conn_id=0) 09:58:53,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90258, rsp_expected=true, UNICAST3: DATA, seqno=201, TP: [cluster_name=ISPN] 09:58:53,734 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,734 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:53,735 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90258, rsp_expected=true, UNICAST3: DATA, seqno=201, TP: [cluster_name=ISPN] 09:58:53,735 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #201, conn_id=0) 09:58:53,735 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#201 09:58:53,735 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90258 09:58:53,735 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:53,735 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,735 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,735 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,737 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,745 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@47eda684] 09:58:53,745 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,745 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:53,745 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,746 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:53,749 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(49467893){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(49467893){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,750 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,759 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:53,759 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:53,759 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,759 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,759 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90258 to Test-NodeC-52778 09:58:53,759 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #199, conn_id=2) 09:58:53,759 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90258, rsp_expected=true, UNICAST3: DATA, seqno=199, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,759 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37412 09:58:53,759 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,759 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:53,759 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90258, rsp_expected=true, UNICAST3: DATA, seqno=199, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,759 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #199, conn_id=2) 09:58:53,759 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#199 09:58:53,760 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,760 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:53,760 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3fbfb43d){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,761 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:53,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:53,762 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:53,763 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37412 09:58:53,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37412. 09:58:53,764 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37412}. ACQUIRED => RELEASED 09:58:53,765 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37412}? true 09:58:53,765 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37412} 09:58:53,765 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37412}, null) => true 09:58:53,765 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90256 to Test-NodeA-7051 09:58:53,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #202, conn_id=0) 09:58:53,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90256, rsp_expected=true, UNICAST3: DATA, seqno=202, TP: [cluster_name=ISPN] 09:58:53,767 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,767 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,767 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37412 09:58:53,768 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90256, rsp_expected=true, UNICAST3: DATA, seqno=202, TP: [cluster_name=ISPN] 09:58:53,769 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #202, conn_id=0) 09:58:53,769 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#202 09:58:53,770 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,770 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,772 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,779 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4c71200f] 09:58:53,780 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,781 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:53,781 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:53,781 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:53,786 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,786 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,786 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:53,792 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,794 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,794 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,794 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90266] on Test-NodeC-52778 09:58:53,795 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #200, conn_id=2) 09:58:53,795 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90266, rsp_expected=true, UNICAST3: DATA, seqno=200, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,797 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,797 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,798 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90266, rsp_expected=true, UNICAST3: DATA, seqno=200, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,799 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #200, conn_id=2) 09:58:53,799 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#200 09:58:53,800 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90266 09:58:53,801 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,801 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,801 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37419. timeout=10000 (MILLISECONDS) 09:58:53,801 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37419. Timeout=10000 (MILLISECONDS) 09:58:53,801 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37419} 09:58:53,802 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37419}. Current=null 09:58:53,802 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37419}) => true 09:58:53,803 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37419}. WAITING => ACQUIRED 09:58:53,803 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37419} successfully acquired the lock. 09:58:53,803 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@303a04fd] 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37419. timeout=10000 (MILLISECONDS) 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37419. Timeout=10000 (MILLISECONDS) 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37419} 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5bca2ae7){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90270] on Test-NodeA-7051 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #203, conn_id=0) 09:58:53,803 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90270, rsp_expected=true, UNICAST3: DATA, seqno=203, TP: [cluster_name=ISPN] 09:58:53,803 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,803 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:53,812 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90270, rsp_expected=true, UNICAST3: DATA, seqno=203, TP: [cluster_name=ISPN] 09:58:53,812 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #203, conn_id=0) 09:58:53,812 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#203 09:58:53,813 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90270 09:58:53,815 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:53,815 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,816 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,816 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6d8ea648] 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:53,817 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(11d5c3d7){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,818 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,819 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,820 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(11d5c3d7){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,821 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:53,821 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,826 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,833 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:53,834 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:53,835 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,835 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,835 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90270 to Test-NodeC-52778 09:58:53,837 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #201, conn_id=2) 09:58:53,837 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90270, rsp_expected=true, UNICAST3: DATA, seqno=201, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,841 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37419 09:58:53,841 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,842 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:53,844 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90270, rsp_expected=true, UNICAST3: DATA, seqno=201, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,845 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #201, conn_id=2) 09:58:53,845 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#201 09:58:53,845 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,847 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:53,848 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5bca2ae7){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,850 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:53,853 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,854 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,857 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:53,857 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:53,858 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,859 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37419 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37419. 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37419}. ACQUIRED => RELEASED 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37419}? true 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37419} 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37419}, null) => true 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90266 to Test-NodeA-7051 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #204, conn_id=0) 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90266, rsp_expected=true, UNICAST3: DATA, seqno=204, TP: [cluster_name=ISPN] 09:58:53,862 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37419 09:58:53,862 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,862 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,867 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90266, rsp_expected=true, UNICAST3: DATA, seqno=204, TP: [cluster_name=ISPN] 09:58:53,867 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #204, conn_id=0) 09:58:53,868 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#204 09:58:53,868 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,868 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,868 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,869 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@787882f] 09:58:53,869 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,869 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:53,869 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:53,869 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:53,870 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,870 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,879 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:53,880 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,880 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,882 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:53,882 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90284] on Test-NodeB-10318 09:58:53,883 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #114, conn_id=1) 09:58:53,883 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90284, rsp_expected=true, UNICAST3: DATA, seqno=114, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,884 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,884 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:53,885 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90284, rsp_expected=true, UNICAST3: DATA, seqno=114, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,885 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #114, conn_id=1) 09:58:53,886 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#114 09:58:53,887 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90284 09:58:53,887 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,889 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,889 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37429. timeout=10000 (MILLISECONDS) 09:58:53,889 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37429. Timeout=10000 (MILLISECONDS) 09:58:53,889 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37429} 09:58:53,889 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37429}. Current=null 09:58:53,889 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37429}) => true 09:58:53,891 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37429}. WAITING => ACQUIRED 09:58:53,892 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37429} successfully acquired the lock. 09:58:53,892 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,892 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,892 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@15cb9033] 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37429. timeout=10000 (MILLISECONDS) 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37429. Timeout=10000 (MILLISECONDS) 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37429} 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(304b782c){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90290] on Test-NodeC-52778 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #50, conn_id=1) 09:58:53,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90290, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,895 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,895 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,897 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90290, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,898 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #50, conn_id=1) 09:58:53,898 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#50 09:58:53,898 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90290 09:58:53,901 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:53,902 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,909 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,911 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,911 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5fc90600] 09:58:53,911 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,912 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:53,912 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,912 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:53,913 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,913 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,913 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:53,913 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2520b687){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,913 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,914 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,915 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2520b687){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,915 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:53,916 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,917 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,917 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:53,917 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:53,917 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,918 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,920 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90290 to Test-NodeB-10318 09:58:53,920 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #50, conn_id=1) 09:58:53,920 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90290, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,920 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37429 09:58:53,920 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,922 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:53,922 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90290, rsp_expected=true, UNICAST3: DATA, seqno=50, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,922 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #50, conn_id=1) 09:58:53,923 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#50 09:58:53,924 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,924 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,925 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(304b782c){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,926 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37429 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37429. 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37429}. ACQUIRED => RELEASED 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37429}? true 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37429} 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37429}, null) => true 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90284 to Test-NodeA-7051 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #116, conn_id=0) 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90284, rsp_expected=true, UNICAST3: DATA, seqno=116, TP: [cluster_name=ISPN] 09:58:53,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37429 09:58:53,927 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,931 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,931 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90284, rsp_expected=true, UNICAST3: DATA, seqno=116, TP: [cluster_name=ISPN] 09:58:53,931 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #116, conn_id=0) 09:58:53,931 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#116 09:58:53,932 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,932 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:53,936 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,936 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@202f1821] 09:58:53,937 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,937 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:53,939 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:53,939 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:53,940 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,940 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,941 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:53,941 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,951 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,953 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:53,953 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90307] on Test-NodeC-52778 09:58:53,954 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #202, conn_id=2) 09:58:53,955 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90307, rsp_expected=true, UNICAST3: DATA, seqno=202, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,956 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,957 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90307, rsp_expected=true, UNICAST3: DATA, seqno=202, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #202, conn_id=2) 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#202 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90307 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37438. timeout=10000 (MILLISECONDS) 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37438. Timeout=10000 (MILLISECONDS) 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37438} 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37438}. Current=null 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37438}) => true 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37438}. WAITING => ACQUIRED 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37438} successfully acquired the lock. 09:58:53,957 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@69617e0b] 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37438. timeout=10000 (MILLISECONDS) 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37438. Timeout=10000 (MILLISECONDS) 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37438} 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2326660f){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,957 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,958 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,958 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,958 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:53,958 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90308] on Test-NodeA-7051 09:58:53,958 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #205, conn_id=0) 09:58:53,958 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90308, rsp_expected=true, UNICAST3: DATA, seqno=205, TP: [cluster_name=ISPN] 09:58:53,958 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,958 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:53,958 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90308, rsp_expected=true, UNICAST3: DATA, seqno=205, TP: [cluster_name=ISPN] 09:58:53,958 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #205, conn_id=0) 09:58:53,958 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#205 09:58:53,958 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90308 09:58:53,958 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:53,958 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,958 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3b268eef] 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(415efbf8){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(415efbf8){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,958 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:53,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:53,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90308 to Test-NodeC-52778 09:58:53,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #203, conn_id=2) 09:58:53,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90308, rsp_expected=true, UNICAST3: DATA, seqno=203, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,959 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37438 09:58:53,959 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:53,959 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:53,959 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90308, rsp_expected=true, UNICAST3: DATA, seqno=203, conn_id=2, TP: [cluster_name=ISPN] 09:58:53,959 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #203, conn_id=2) 09:58:53,959 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#203 09:58:53,959 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,959 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2326660f){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37438 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37438. 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37438}. ACQUIRED => RELEASED 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37438}? true 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37438} 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37438}, null) => true 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90307 to Test-NodeA-7051 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #206, conn_id=0) 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90307, rsp_expected=true, UNICAST3: DATA, seqno=206, TP: [cluster_name=ISPN] 09:58:53,959 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37438 09:58:53,959 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:53,959 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:53,959 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90307, rsp_expected=true, UNICAST3: DATA, seqno=206, TP: [cluster_name=ISPN] 09:58:53,959 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #206, conn_id=0) 09:58:53,959 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#206 09:58:53,959 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:53,962 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:53,963 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:53,970 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:53,970 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:53,971 DEBUG (testng-Test:[]) [Test] Found key key-to-change0 with primary owner Test-NodeA-7051, segment 51 09:58:53,971 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@49438c70] 09:58:53,985 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:53,985 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:58:53,986 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:37444. timeout=10000 (MILLISECONDS) 09:58:53,986 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37444. Timeout=10000 (MILLISECONDS) 09:58:53,986 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37444} 09:58:53,986 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37444}. Current=null 09:58:53,986 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37444}) => true 09:58:53,986 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37444}. WAITING => ACQUIRED 09:58:53,986 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37444} successfully acquired the lock. 09:58:53,986 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:53,986 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:53,986 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,986 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:53,986 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:53,986 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(68483359){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:53,992 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:53,992 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:53,992 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:53,992 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:53,993 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:53,993 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:53,993 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90315] on Test-NodeB-10318 09:58:53,993 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #115, conn_id=1) 09:58:53,993 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90315, rsp_expected=true, UNICAST3: DATA, seqno=115, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,993 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:53,994 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:53,994 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90315, rsp_expected=true, UNICAST3: DATA, seqno=115, conn_id=1, TP: [cluster_name=ISPN] 09:58:53,994 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #115, conn_id=1) 09:58:53,994 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#115 09:58:53,994 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90315 09:58:53,994 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:53,994 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:53,995 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:53,995 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:53,996 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:53,996 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6e9848b4] 09:58:53,996 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:53,996 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:58:53,997 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:53,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:53,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:53,998 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,000 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:54,000 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(17fdfca6){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(17fdfca6){key=key-to-change0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:54,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:54,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=initial-value} in container 09:58:54,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,018 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90315 to Test-NodeA-7051 09:58:54,018 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #117, conn_id=0) 09:58:54,019 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90315, rsp_expected=true, UNICAST3: DATA, seqno=117, TP: [cluster_name=ISPN] 09:58:54,019 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37444 09:58:54,019 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,019 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,019 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90315, rsp_expected=true, UNICAST3: DATA, seqno=117, TP: [cluster_name=ISPN] 09:58:54,020 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #117, conn_id=0) 09:58:54,022 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#117 09:58:54,022 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,022 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:54,022 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(68483359){key=key-to-change0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,022 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:54,022 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,022 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,022 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:54,022 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=initial-value} in container 09:58:54,022 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,022 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:37444 09:58:54,022 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37444. 09:58:54,022 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37444}. ACQUIRED => RELEASED 09:58:54,022 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37444}? true 09:58:54,022 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37444} 09:58:54,022 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37444}, null) => true 09:58:54,022 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:54,022 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_invoked * 1 09:58:54,022 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:54,027 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 0915a73c-1a91-4d6c-820f-f0b3c4cbffcb 09:58:54,029 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@9eae063[Not completed] to remote execution at node Test-NodeB-10318 09:58:54,029 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2b750236] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,030 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2b750236], mode=SYNCHRONOUS, timeout=15000 09:58:54,032 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2b750236] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:54,034 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90326] on Test-NodeB-10318 09:58:54,034 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #116, conn_id=1) 09:58:54,045 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90326, rsp_expected=true, UNICAST3: DATA, seqno=116, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,045 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,046 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:54,046 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90326, rsp_expected=true, UNICAST3: DATA, seqno=116, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,046 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #116, conn_id=1) 09:58:54,046 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#116 09:58:54,046 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90326 09:58:54,046 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@72bb059a[Not completed] to remote execution at node Test-NodeC-52778 09:58:54,046 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3353a199] [sender=Test-NodeA-7051] 09:58:54,048 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:54,048 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,048 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3353a199] 09:58:54,046 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2b750236] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,048 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2b750236], mode=SYNCHRONOUS, timeout=15000 09:58:54,048 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2b750236] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:54,048 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90330] on Test-NodeC-52778 09:58:54,048 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #204, conn_id=2) 09:58:54,048 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90330, rsp_expected=true, UNICAST3: DATA, seqno=204, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,049 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,049 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:54,049 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90330, rsp_expected=true, UNICAST3: DATA, seqno=204, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,049 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #204, conn_id=2) 09:58:54,049 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#204 09:58:54,049 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90330 09:58:54,049 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3ba03ceb] [sender=Test-NodeA-7051] 09:58:54,049 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:54,049 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,049 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3ba03ceb] 09:58:54,049 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 0915a73c-1a91-4d6c-820f-f0b3c4cbffcb 09:58:54,049 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3ba03ceb] 09:58:54,049 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90330 to Test-NodeA-7051 09:58:54,049 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #207, conn_id=0) 09:58:54,049 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90330, rsp_expected=true, UNICAST3: DATA, seqno=207, TP: [cluster_name=ISPN] 09:58:54,048 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 0915a73c-1a91-4d6c-820f-f0b3c4cbffcb 09:58:54,049 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,049 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,051 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90330, rsp_expected=true, UNICAST3: DATA, seqno=207, TP: [cluster_name=ISPN] 09:58:54,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3353a199] 09:58:54,051 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #207, conn_id=0) 09:58:54,051 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#207 09:58:54,051 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,051 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2b750236] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:54,051 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90326 to Test-NodeA-7051 09:58:54,054 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #118, conn_id=0) 09:58:54,054 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90326, rsp_expected=true, UNICAST3: DATA, seqno=118, TP: [cluster_name=ISPN] 09:58:54,054 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,054 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,060 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90326, rsp_expected=true, UNICAST3: DATA, seqno=118, TP: [cluster_name=ISPN] 09:58:54,060 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #118, conn_id=0) 09:58:54,060 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#118 09:58:54,061 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,061 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2b750236] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:54,061 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 0915a73c-1a91-4d6c-820f-f0b3c4cbffcb requests initial state for cache 09:58:54,061 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@3f7c9c08] 09:58:54,062 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:54,063 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_invoked * 1 (available = 1, total = 1) 09:58:54,063 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_released * 1 09:58:54,063 TRACE (testng-Test:[]) [CheckPoint] Received event pre_retrieve_entry_invoked * 1 (available = 0, total = 1) 09:58:54,067 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2e471eef] 09:58:54,072 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:54,072 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:58:54,074 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:37451. timeout=10000 (MILLISECONDS) 09:58:54,075 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37451. Timeout=10000 (MILLISECONDS) 09:58:54,078 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37451} 09:58:54,078 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37451}. Current=null 09:58:54,078 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37451}) => true 09:58:54,078 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37451}. WAITING => ACQUIRED 09:58:54,078 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37451} successfully acquired the lock. 09:58:54,078 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:54,080 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:54,082 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,099 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:54,099 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:54,099 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4598dc){key=key-to-change0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:54,099 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,099 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,102 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:54,103 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,103 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,107 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:54,107 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90339] on Test-NodeB-10318 09:58:54,107 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #117, conn_id=1) 09:58:54,107 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90339, rsp_expected=true, UNICAST3: DATA, seqno=117, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,107 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,107 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:54,109 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90339, rsp_expected=true, UNICAST3: DATA, seqno=117, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,109 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #117, conn_id=1) 09:58:54,109 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#117 09:58:54,113 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90339 09:58:54,113 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:54,114 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,114 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@9eacc04] 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4a7ace8c){key=key-to-change0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4a7ace8c){key=key-to-change0, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change0, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=changed-value} in container 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90339 to Test-NodeA-7051 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #119, conn_id=0) 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90339, rsp_expected=true, UNICAST3: DATA, seqno=119, TP: [cluster_name=ISPN] 09:58:54,116 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37451 09:58:54,114 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,116 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,116 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:58:54,117 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90339, rsp_expected=true, UNICAST3: DATA, seqno=119, TP: [cluster_name=ISPN] 09:58:54,117 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #119, conn_id=0) 09:58:54,117 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#119 09:58:54,119 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:54,120 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #117) 09:58:54,119 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change0, value=changed-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:58:54,120 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4598dc){key=key-to-change0, value=changed-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,120 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:54,120 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=117, conn_id=1, ts=63, TP: [cluster_name=ISPN] 09:58:54,121 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,121 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #50) 09:58:54,124 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #119) 09:58:54,125 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=119, ts=74, TP: [cluster_name=ISPN] 09:58:54,125 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #207) 09:58:54,125 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=207, ts=75, TP: [cluster_name=ISPN] 09:58:54,125 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,125 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:54,125 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,125 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:54,127 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=119, ts=74, TP: [cluster_name=ISPN] 09:58:54,120 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,128 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=207, ts=75, TP: [cluster_name=ISPN] 09:58:54,128 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #119, conn-id=0, ts=74) 09:58:54,127 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #50) 09:58:54,129 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=50, conn_id=1, ts=65, TP: [cluster_name=ISPN] 09:58:54,122 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=50, conn_id=1, ts=64, TP: [cluster_name=ISPN] 09:58:54,122 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:54,130 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,130 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=117, conn_id=1, ts=63, TP: [cluster_name=ISPN] 09:58:54,130 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #117, conn-id=1, ts=63) 09:58:54,130 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:54,129 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,129 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #204) 09:58:54,131 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:54,131 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=204, conn_id=2, ts=66, TP: [cluster_name=ISPN] 09:58:54,131 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,129 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #207, conn-id=0, ts=75) 09:58:54,132 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=false value=changed-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,131 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=50, conn_id=1, ts=65, TP: [cluster_name=ISPN] 09:58:54,131 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:54,130 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=50, conn_id=1, ts=64, TP: [cluster_name=ISPN] 09:58:54,132 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #50, conn-id=1, ts=64) 09:58:54,135 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #50, conn-id=1, ts=65) 09:58:54,132 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=ImmortalCacheEntry{key=key-to-change0, value=initial-value}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=changed-value 09:58:54,135 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=204, conn_id=2, ts=66, TP: [cluster_name=ISPN] 09:58:54,136 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #204, conn-id=2, ts=66) 09:58:54,136 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=changed-value} in container 09:58:54,138 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:54,138 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:37451 09:58:54,138 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37451. 09:58:54,138 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37451}. ACQUIRED => RELEASED 09:58:54,138 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37451}? true 09:58:54,138 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37451} 09:58:54,138 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37451}, null) => true 09:58:54,138 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:54,139 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_released * 999999999 (available = 999999999, total = 999999999) 09:58:54,139 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_retrieve_entry_released * 1 (available = 999999998, total = 999999999) 09:58:54,139 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:54,139 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705111 09:58:54,139 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705111 excluding keys [] 09:58:54,141 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,141 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:54,141 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:54,144 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:54,144 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90346] on Test-NodeB-10318 09:58:54,146 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #118, conn_id=1) 09:58:54,146 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90346, rsp_expected=true, UNICAST3: DATA, seqno=118, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,149 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,149 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:58:54,156 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90346, rsp_expected=true, UNICAST3: DATA, seqno=118, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,156 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #118, conn_id=1) 09:58:54,157 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#118 09:58:54,157 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90346 09:58:54,167 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:54,167 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,167 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:54,168 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705111 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:54,171 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@41be5f01] 09:58:54,171 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:54,171 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705111 09:58:54,172 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705111 09:58:54,172 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705111 09:58:54,172 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:54,172 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705111 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:54,172 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705111 09:58:54,172 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,172 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:54,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:54,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90353] on Test-NodeA-7051 09:58:54,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #120, conn_id=0) 09:58:54,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90353, rsp_expected=true, UNICAST3: DATA, seqno=120, TP: [cluster_name=ISPN] 09:58:54,173 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (225 bytes (1125.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,173 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (228 bytes) 09:58:54,173 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=151 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90353, rsp_expected=true, UNICAST3: DATA, seqno=120, TP: [cluster_name=ISPN] 09:58:54,173 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #120, conn_id=0) 09:58:54,173 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#120 09:58:54,173 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90353 09:58:54,173 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:54,173 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:54,173 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,173 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:54,173 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705111 with [] suspected segments. 09:58:54,173 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:54,173 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:54,173 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:54,173 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90353 to Test-NodeB-10318 09:58:54,173 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #119, conn_id=1) 09:58:54,173 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90353, rsp_expected=true, UNICAST3: DATA, seqno=119, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,173 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,173 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:54,174 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90353, rsp_expected=true, UNICAST3: DATA, seqno=119, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,174 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #119, conn_id=1) 09:58:54,174 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#119 09:58:54,174 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:54,174 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:54,174 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:54,174 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90346 to Test-NodeA-7051 09:58:54,174 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #121, conn_id=0) 09:58:54,174 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90346, rsp_expected=true, UNICAST3: DATA, seqno=121, TP: [cluster_name=ISPN] 09:58:54,174 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,174 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:54,174 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90346, rsp_expected=true, UNICAST3: DATA, seqno=121, TP: [cluster_name=ISPN] 09:58:54,174 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #121, conn_id=0) 09:58:54,174 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#121 09:58:54,174 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:54,174 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:54,178 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705111 excluding keys [] 09:58:54,178 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,179 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:54,179 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:54,179 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:54,181 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90356] on Test-NodeC-52778 09:58:54,181 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #205, conn_id=2) 09:58:54,183 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90356, rsp_expected=true, UNICAST3: DATA, seqno=205, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,183 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (607 bytes (3035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,184 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (610 bytes) 09:58:54,185 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90356, rsp_expected=true, UNICAST3: DATA, seqno=205, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,185 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #205, conn_id=2) 09:58:54,185 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#205 09:58:54,185 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90356 09:58:54,185 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:54,186 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,186 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:54,186 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,187 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705111 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:54,187 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@66d96099] 09:58:54,188 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:54,188 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705111 09:58:54,188 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705111 09:58:54,189 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705111 09:58:54,189 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:54,190 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705111 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:54,190 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705111 09:58:54,190 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,191 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:54,192 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:54,192 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90361] on Test-NodeA-7051 09:58:54,192 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #208, conn_id=0) 09:58:54,192 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90361, rsp_expected=true, UNICAST3: DATA, seqno=208, TP: [cluster_name=ISPN] 09:58:54,193 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (315 bytes (1575.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,267 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:58:54,268 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:58:54,269 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:58:54,270 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:58:54,271 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:54,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:54,274 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (318 bytes) 09:58:54,281 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=241 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90361, rsp_expected=true, UNICAST3: DATA, seqno=208, TP: [cluster_name=ISPN] 09:58:54,281 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #208, conn_id=0) 09:58:54,283 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#208 09:58:54,283 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90361 09:58:54,283 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:54,283 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:54,283 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,283 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:54,284 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705111 with [] suspected segments. 09:58:54,284 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:54,285 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:54,285 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705111 as completed! 09:58:54,287 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:54,295 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90361 to Test-NodeC-52778 09:58:54,295 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #206, conn_id=2) 09:58:54,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90361, rsp_expected=true, UNICAST3: DATA, seqno=206, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,297 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,297 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:54,303 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90361, rsp_expected=true, UNICAST3: DATA, seqno=206, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,305 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #206, conn_id=2) 09:58:54,306 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#206 09:58:54,307 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:54,307 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:54,307 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:54,307 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90356 to Test-NodeA-7051 09:58:54,310 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #209, conn_id=0) 09:58:54,310 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90356, rsp_expected=true, UNICAST3: DATA, seqno=209, TP: [cluster_name=ISPN] 09:58:54,310 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,310 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:54,311 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90356, rsp_expected=true, UNICAST3: DATA, seqno=209, TP: [cluster_name=ISPN] 09:58:54,311 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #209, conn_id=0) 09:58:54,311 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#209 09:58:54,311 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:54,313 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:54,314 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:54,315 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 2 for id Test-NodeA-705111 09:58:54,315 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:54,315 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 2 09:58:54,316 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705111 09:58:54,316 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705111 being completed: true 09:58:54,316 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,316 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:54,316 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:54,316 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:54,316 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:54,316 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:54,316 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705111 09:58:54,317 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:54,321 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:54,321 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:54,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:54,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:54,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:54,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:54,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:54,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:54,325 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:54,325 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:54,325 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:54,329 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:54,330 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:54,331 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:54,332 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:54,332 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:54,333 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:54,333 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:54,333 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:54,333 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:54,333 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:54,333 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:54,334 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:54,334 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:54,334 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:54,335 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:54,335 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:54,335 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:54,336 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:54,336 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:54,336 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:54,336 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:54,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:54,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:54,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:54,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:54,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:54,338 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:54,338 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:54,338 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:54,338 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:54,338 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:54,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:54,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:54,341 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:54,342 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:54,342 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:54,343 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:54,345 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:54,345 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:54,346 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:54,347 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:54,352 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:54,352 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:54,359 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:54,361 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:54,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:54,362 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:54,364 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:54,364 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,364 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,365 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,366 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,367 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,368 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,369 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:54,370 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:54,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:54,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:54,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:54,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:54,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:54,372 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,378 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change0, value=changed-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:54,378 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:54,379 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:54,381 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 0915a73c-1a91-4d6c-820f-f0b3c4cbffcb initial state for cache completed 09:58:54,381 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:54,387 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@601e6271[Not completed] to self 09:58:54,387 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@21b55a63[Not completed] to remote execution at node Test-NodeB-10318 09:58:54,388 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@201a1ae7] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,388 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@201a1ae7], mode=SYNCHRONOUS, timeout=15000 09:58:54,388 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@201a1ae7] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:54,388 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90392] on Test-NodeB-10318 09:58:54,397 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #120, conn_id=1) 09:58:54,400 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90392, rsp_expected=true, UNICAST3: DATA, seqno=120, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,400 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,400 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@2c721e65[Not completed] to remote execution at node Test-NodeC-52778 09:58:54,400 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@201a1ae7] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,405 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@201a1ae7], mode=SYNCHRONOUS, timeout=15000 09:58:54,400 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:54,405 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@201a1ae7] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:54,405 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90396] on Test-NodeC-52778 09:58:54,405 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90392, rsp_expected=true, UNICAST3: DATA, seqno=120, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,412 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #120, conn_id=1) 09:58:54,405 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #207, conn_id=2) 09:58:54,412 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90396, rsp_expected=true, UNICAST3: DATA, seqno=207, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,412 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,412 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#120 09:58:54,412 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:54,412 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90392 09:58:54,412 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90396, rsp_expected=true, UNICAST3: DATA, seqno=207, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,428 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #207, conn_id=2) 09:58:54,412 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ebc56b8] [sender=Test-NodeA-7051] 09:58:54,428 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:54,428 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#207 09:58:54,429 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,429 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ebc56b8] 09:58:54,430 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 0915a73c-1a91-4d6c-820f-f0b3c4cbffcb 09:58:54,430 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ebc56b8] 09:58:54,430 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90392 to Test-NodeA-7051 09:58:54,430 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90396 09:58:54,430 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #122, conn_id=0) 09:58:54,430 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@1aeaad28] [sender=Test-NodeA-7051] 09:58:54,430 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:54,430 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,430 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@1aeaad28] 09:58:54,430 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 0915a73c-1a91-4d6c-820f-f0b3c4cbffcb 09:58:54,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@1aeaad28] 09:58:54,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90396 to Test-NodeA-7051 09:58:54,433 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #210, conn_id=0) 09:58:54,434 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90396, rsp_expected=true, UNICAST3: DATA, seqno=210, TP: [cluster_name=ISPN] 09:58:54,434 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,434 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,434 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90396, rsp_expected=true, UNICAST3: DATA, seqno=210, TP: [cluster_name=ISPN] 09:58:54,434 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #210, conn_id=0) 09:58:54,434 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#210 09:58:54,434 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,434 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@201a1ae7] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:54,430 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90392, rsp_expected=true, UNICAST3: DATA, seqno=122, TP: [cluster_name=ISPN] 09:58:54,437 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,437 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,437 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90392, rsp_expected=true, UNICAST3: DATA, seqno=122, TP: [cluster_name=ISPN] 09:58:54,437 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #122, conn_id=0) 09:58:54,437 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#122 09:58:54,437 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,437 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@201a1ae7] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:54,438 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:54,438 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:54,438 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testModificationAfterIterationBeganButNotIteratedValueYetOwnerClustered 09:58:54,438 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:54,438 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:54,438 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:54,441 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 7 09:58:54,441 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:54,441 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:54,441 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:54,442 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:54,443 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:54,444 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:54,445 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:54,445 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:54,447 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:54,448 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:54,458 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndCompletedSegmentValueNonOwnerClustered 09:58:54,458 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7356b67f] 09:58:54,458 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:54,458 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:54,458 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:54,458 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:54,458 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,458 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,458 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:54,458 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,458 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,458 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:54,458 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90398] on Test-NodeB-10318 09:58:54,458 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #121, conn_id=1) 09:58:54,459 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90398, rsp_expected=true, UNICAST3: DATA, seqno=121, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,459 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,459 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90398, rsp_expected=true, UNICAST3: DATA, seqno=121, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #121, conn_id=1) 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#121 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90398 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37487. timeout=10000 (MILLISECONDS) 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37487. Timeout=10000 (MILLISECONDS) 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37487} 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37487}. Current=null 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37487}) => true 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37487}. WAITING => ACQUIRED 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37487} successfully acquired the lock. 09:58:54,459 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@446dbed9] 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37487. timeout=10000 (MILLISECONDS) 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37487. Timeout=10000 (MILLISECONDS) 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37487} 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5f2e9914){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,459 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,460 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,460 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,460 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:54,460 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90399] on Test-NodeC-52778 09:58:54,460 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #51, conn_id=1) 09:58:54,460 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90399, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,460 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,460 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:54,460 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90399, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,460 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #51, conn_id=1) 09:58:54,460 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#51 09:58:54,460 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90399 09:58:54,460 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:54,460 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,460 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,460 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,460 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,460 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6adcf9bc] 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(64e8a558){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(64e8a558){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90399 to Test-NodeB-10318 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #51, conn_id=1) 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90399, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,466 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37487 09:58:54,466 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,466 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:54,466 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90399, rsp_expected=true, UNICAST3: DATA, seqno=51, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,466 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #51, conn_id=1) 09:58:54,466 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#51 09:58:54,467 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,467 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5f2e9914){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37487 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37487. 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37487}. ACQUIRED => RELEASED 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37487}? true 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37487} 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37487}, null) => true 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90398 to Test-NodeA-7051 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #123, conn_id=0) 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90398, rsp_expected=true, UNICAST3: DATA, seqno=123, TP: [cluster_name=ISPN] 09:58:54,471 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37487 09:58:54,471 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,472 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,476 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90398, rsp_expected=true, UNICAST3: DATA, seqno=123, TP: [cluster_name=ISPN] 09:58:54,476 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #123, conn_id=0) 09:58:54,479 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#123 09:58:54,486 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,486 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:54,486 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,486 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@20471f9d] 09:58:54,486 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:54,486 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:54,486 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:54,493 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:54,493 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,493 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,493 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:54,493 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,493 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,493 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:54,493 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90403] on Test-NodeC-52778 09:58:54,493 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #208, conn_id=2) 09:58:54,493 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90403, rsp_expected=true, UNICAST3: DATA, seqno=208, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,493 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,493 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:54,494 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90403, rsp_expected=true, UNICAST3: DATA, seqno=208, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,498 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #208, conn_id=2) 09:58:54,498 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#208 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90403 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37490. timeout=10000 (MILLISECONDS) 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37490. Timeout=10000 (MILLISECONDS) 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37490} 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37490}. Current=null 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37490}) => true 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37490}. WAITING => ACQUIRED 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37490} successfully acquired the lock. 09:58:54,502 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,502 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,503 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,503 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1264e587] 09:58:54,503 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,505 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:54,509 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37490. timeout=10000 (MILLISECONDS) 09:58:54,510 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37490. Timeout=10000 (MILLISECONDS) 09:58:54,510 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37490} 09:58:54,510 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:54,510 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2ec9a85c){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:54,511 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90408] on Test-NodeA-7051 09:58:54,512 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #211, conn_id=0) 09:58:54,512 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90408, rsp_expected=true, UNICAST3: DATA, seqno=211, TP: [cluster_name=ISPN] 09:58:54,512 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,512 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:54,514 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90408, rsp_expected=true, UNICAST3: DATA, seqno=211, TP: [cluster_name=ISPN] 09:58:54,514 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #211, conn_id=0) 09:58:54,516 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#211 09:58:54,516 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90408 09:58:54,518 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:54,520 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,520 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,520 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,520 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,520 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@69d0b936] 09:58:54,520 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,522 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:54,523 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:54,528 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:54,528 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,529 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,529 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:54,529 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5fe71ecf){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,531 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,531 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,531 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5fe71ecf){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,531 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:54,531 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,531 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,532 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:54,532 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:54,534 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,534 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,536 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90408 to Test-NodeC-52778 09:58:54,536 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #209, conn_id=2) 09:58:54,537 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90408, rsp_expected=true, UNICAST3: DATA, seqno=209, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,541 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37490 09:58:54,541 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,542 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:54,543 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90408, rsp_expected=true, UNICAST3: DATA, seqno=209, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,547 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #209, conn_id=2) 09:58:54,547 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#209 09:58:54,552 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,552 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:54,553 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2ec9a85c){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,553 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:54,553 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,553 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,554 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:54,554 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:54,554 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,556 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37490 09:58:54,556 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37490. 09:58:54,556 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37490}. ACQUIRED => RELEASED 09:58:54,556 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37490}? true 09:58:54,556 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37490} 09:58:54,556 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37490}, null) => true 09:58:54,556 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:54,556 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,559 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90403 to Test-NodeA-7051 09:58:54,559 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #212, conn_id=0) 09:58:54,561 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90403, rsp_expected=true, UNICAST3: DATA, seqno=212, TP: [cluster_name=ISPN] 09:58:54,566 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,566 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37490 09:58:54,571 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,571 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90403, rsp_expected=true, UNICAST3: DATA, seqno=212, TP: [cluster_name=ISPN] 09:58:54,572 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #212, conn_id=0) 09:58:54,572 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#212 09:58:54,572 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,572 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:54,572 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,572 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4e3b6c42] 09:58:54,572 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:54,574 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:54,577 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:54,578 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:54,578 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,579 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,579 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:54,580 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,580 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,580 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:54,581 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90429] on Test-NodeC-52778 09:58:54,581 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #210, conn_id=2) 09:58:54,581 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90429, rsp_expected=true, UNICAST3: DATA, seqno=210, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,582 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,582 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:54,583 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90429, rsp_expected=true, UNICAST3: DATA, seqno=210, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,583 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #210, conn_id=2) 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#210 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90429 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37502. timeout=10000 (MILLISECONDS) 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37502. Timeout=10000 (MILLISECONDS) 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37502} 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37502}. Current=null 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37502}) => true 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37502}. WAITING => ACQUIRED 09:58:54,584 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37502} successfully acquired the lock. 09:58:54,585 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,586 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,585 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,586 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@68662504] 09:58:54,587 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,587 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:54,587 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37502. timeout=10000 (MILLISECONDS) 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37502. Timeout=10000 (MILLISECONDS) 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37502} 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(35db3a8){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:54,591 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90433] on Test-NodeB-10318 09:58:54,592 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #52, conn_id=1) 09:58:54,594 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90433, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,594 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,594 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:54,594 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90433, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,594 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #52, conn_id=1) 09:58:54,595 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#52 09:58:54,595 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90433 09:58:54,595 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:54,595 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,595 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,595 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,595 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,595 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1767583d] 09:58:54,595 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,595 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:54,596 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:54,596 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:54,596 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,596 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,596 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:54,596 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1991b7f4){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,596 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,608 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,610 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1991b7f4){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,610 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:54,611 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,611 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,611 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:54,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:54,613 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,618 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90433 to Test-NodeC-52778 09:58:54,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #52, conn_id=1) 09:58:54,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90433, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,620 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,620 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:54,620 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37502 09:58:54,626 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #123) 09:58:54,626 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=123, ts=76, TP: [cluster_name=ISPN] 09:58:54,626 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #212) 09:58:54,626 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=212, ts=77, TP: [cluster_name=ISPN] 09:58:54,626 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:54,626 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:54,626 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:54,626 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=212, ts=77, TP: [cluster_name=ISPN] 09:58:54,627 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #212, conn-id=0, ts=77) 09:58:54,627 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=123, ts=76, TP: [cluster_name=ISPN] 09:58:54,627 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #123, conn-id=0, ts=76) 09:58:54,630 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #121) 09:58:54,630 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=121, conn_id=1, ts=65, TP: [cluster_name=ISPN] 09:58:54,630 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #52) 09:58:54,630 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=52, conn_id=1, ts=66, TP: [cluster_name=ISPN] 09:58:54,620 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90433, rsp_expected=true, UNICAST3: DATA, seqno=52, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,631 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #51) 09:58:54,631 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #52, conn_id=1) 09:58:54,630 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,633 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:54,633 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#52 09:58:54,633 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=51, conn_id=1, ts=67, TP: [cluster_name=ISPN] 09:58:54,635 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=121, conn_id=1, ts=65, TP: [cluster_name=ISPN] 09:58:54,635 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,635 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,637 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #210) 09:58:54,637 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=210, conn_id=2, ts=68, TP: [cluster_name=ISPN] 09:58:54,637 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,638 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:54,637 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:54,636 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #121, conn-id=1, ts=65) 09:58:54,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(35db3a8){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,638 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=52, conn_id=1, ts=66, TP: [cluster_name=ISPN] 09:58:54,639 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #52, conn-id=1, ts=66) 09:58:54,638 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:54,638 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:54,639 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=51, conn_id=1, ts=67, TP: [cluster_name=ISPN] 09:58:54,639 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,639 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,640 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,640 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:54,640 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #51, conn-id=1, ts=67) 09:58:54,640 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=210, conn_id=2, ts=68, TP: [cluster_name=ISPN] 09:58:54,640 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:54,641 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:54,641 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,641 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37502 09:58:54,641 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #210, conn-id=2, ts=68) 09:58:54,642 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37502. 09:58:54,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37502}. ACQUIRED => RELEASED 09:58:54,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37502}? true 09:58:54,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37502} 09:58:54,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37502}, null) => true 09:58:54,643 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:54,644 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,644 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90429 to Test-NodeA-7051 09:58:54,645 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #213, conn_id=0) 09:58:54,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90429, rsp_expected=true, UNICAST3: DATA, seqno=213, TP: [cluster_name=ISPN] 09:58:54,646 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37502 09:58:54,646 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,648 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,658 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90429, rsp_expected=true, UNICAST3: DATA, seqno=213, TP: [cluster_name=ISPN] 09:58:54,658 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #213, conn_id=0) 09:58:54,661 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#213 09:58:54,663 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,663 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:54,664 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,664 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@523c7f82] 09:58:54,665 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:54,665 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:54,665 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:54,665 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:54,665 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,665 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,665 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:54,665 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,665 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,665 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:54,665 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90450] on Test-NodeC-52778 09:58:54,665 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #211, conn_id=2) 09:58:54,665 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90450, rsp_expected=true, UNICAST3: DATA, seqno=211, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,665 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,665 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90450, rsp_expected=true, UNICAST3: DATA, seqno=211, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #211, conn_id=2) 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#211 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90450 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37509. timeout=10000 (MILLISECONDS) 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37509. Timeout=10000 (MILLISECONDS) 09:58:54,665 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37509} 09:58:54,666 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37509}. Current=null 09:58:54,671 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37509}) => true 09:58:54,671 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37509}. WAITING => ACQUIRED 09:58:54,671 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37509} successfully acquired the lock. 09:58:54,671 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,671 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,671 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,673 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4d91bbd] 09:58:54,675 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,676 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:54,676 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37509. timeout=10000 (MILLISECONDS) 09:58:54,676 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37509. Timeout=10000 (MILLISECONDS) 09:58:54,677 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37509} 09:58:54,677 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:54,678 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:54,679 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,680 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:54,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(205f8240){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,683 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,688 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,688 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,688 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,688 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:54,694 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90459] on Test-NodeB-10318 09:58:54,694 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #53, conn_id=1) 09:58:54,696 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90459, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,697 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,697 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:54,697 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90459, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,697 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #53, conn_id=1) 09:58:54,697 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#53 09:58:54,698 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90459 09:58:54,698 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:54,699 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,699 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,699 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@52343c67] 09:58:54,701 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,701 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:54,705 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:54,706 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:54,706 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,708 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,710 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:54,710 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2d3a5670){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2d3a5670){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:54,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,713 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,715 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:54,715 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:54,722 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,722 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,724 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90459 to Test-NodeC-52778 09:58:54,726 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #53, conn_id=1) 09:58:54,726 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90459, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,726 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37509 09:58:54,726 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,726 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:54,727 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90459, rsp_expected=true, UNICAST3: DATA, seqno=53, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,729 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #53, conn_id=1) 09:58:54,730 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#53 09:58:54,730 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,731 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:54,732 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(205f8240){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:54,733 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,734 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:54,735 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:54,738 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,739 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37509 09:58:54,739 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37509. 09:58:54,739 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37509}. ACQUIRED => RELEASED 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37509}? true 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37509} 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37509}, null) => true 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90450 to Test-NodeA-7051 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #214, conn_id=0) 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90450, rsp_expected=true, UNICAST3: DATA, seqno=214, TP: [cluster_name=ISPN] 09:58:54,741 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37509 09:58:54,741 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,741 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,747 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90450, rsp_expected=true, UNICAST3: DATA, seqno=214, TP: [cluster_name=ISPN] 09:58:54,747 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #214, conn_id=0) 09:58:54,753 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#214 09:58:54,759 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,759 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:54,759 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,759 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5dcdbd29] 09:58:54,761 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:54,761 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:54,761 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:54,762 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:54,762 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,762 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,762 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:54,764 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,768 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,769 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:54,772 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90485] on Test-NodeC-52778 09:58:54,773 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #212, conn_id=2) 09:58:54,773 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90485, rsp_expected=true, UNICAST3: DATA, seqno=212, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,773 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,773 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:54,773 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90485, rsp_expected=true, UNICAST3: DATA, seqno=212, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,773 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #212, conn_id=2) 09:58:54,773 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#212 09:58:54,773 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90485 09:58:54,773 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:54,773 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,773 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37516. timeout=10000 (MILLISECONDS) 09:58:54,773 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37516. Timeout=10000 (MILLISECONDS) 09:58:54,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37516} 09:58:54,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37516}. Current=null 09:58:54,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37516}) => true 09:58:54,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37516}. WAITING => ACQUIRED 09:58:54,774 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37516} successfully acquired the lock. 09:58:54,774 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@57d2eac0] 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37516. timeout=10000 (MILLISECONDS) 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37516. Timeout=10000 (MILLISECONDS) 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37516} 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1ccb546b){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90486] on Test-NodeA-7051 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #215, conn_id=0) 09:58:54,774 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90486, rsp_expected=true, UNICAST3: DATA, seqno=215, TP: [cluster_name=ISPN] 09:58:54,774 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,774 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:54,778 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90486, rsp_expected=true, UNICAST3: DATA, seqno=215, TP: [cluster_name=ISPN] 09:58:54,778 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #215, conn_id=0) 09:58:54,778 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#215 09:58:54,778 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90486 09:58:54,778 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:54,778 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,778 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,778 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,779 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,788 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@53dae50f] 09:58:54,788 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:54,788 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:54,788 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:54,788 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:54,794 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,794 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,794 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:54,795 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(455504f8){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,795 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(455504f8){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,796 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90486 to Test-NodeC-52778 09:58:54,798 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #213, conn_id=2) 09:58:54,802 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90486, rsp_expected=true, UNICAST3: DATA, seqno=213, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,804 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37516 09:58:54,804 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:54,804 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:54,809 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90486, rsp_expected=true, UNICAST3: DATA, seqno=213, conn_id=2, TP: [cluster_name=ISPN] 09:58:54,809 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #213, conn_id=2) 09:58:54,809 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#213 09:58:54,809 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,811 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:54,818 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1ccb546b){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:54,818 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:54,818 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:54,818 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:54,818 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:54,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:54,820 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,826 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37516 09:58:54,827 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37516. 09:58:54,827 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37516}. ACQUIRED => RELEASED 09:58:54,829 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37516}? true 09:58:54,830 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37516} 09:58:54,927 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37516}, null) => true 09:58:54,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:54,932 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,932 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90485 to Test-NodeA-7051 09:58:54,932 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #216, conn_id=0) 09:58:54,932 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90485, rsp_expected=true, UNICAST3: DATA, seqno=216, TP: [cluster_name=ISPN] 09:58:54,933 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37516 09:58:54,933 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:54,933 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:54,936 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90485, rsp_expected=true, UNICAST3: DATA, seqno=216, TP: [cluster_name=ISPN] 09:58:54,937 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #216, conn_id=0) 09:58:54,946 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#216 09:58:54,953 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:54,962 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:54,966 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:54,966 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@730e2f11] 09:58:54,969 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:54,969 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:54,969 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:37525. timeout=10000 (MILLISECONDS) 09:58:54,969 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37525. Timeout=10000 (MILLISECONDS) 09:58:54,969 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37525} 09:58:54,969 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37525}. Current=null 09:58:54,977 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37525}) => true 09:58:54,977 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37525}. WAITING => ACQUIRED 09:58:54,977 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37525} successfully acquired the lock. 09:58:54,988 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:54,988 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:54,988 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:54,988 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:54,988 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:54,988 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(44fae257){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:54,988 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:54,988 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:54,988 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:54,988 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:54,988 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:54,988 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:54,989 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90503] on Test-NodeB-10318 09:58:54,989 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #122, conn_id=1) 09:58:54,989 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90503, rsp_expected=true, UNICAST3: DATA, seqno=122, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,989 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:54,989 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:54,989 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90503, rsp_expected=true, UNICAST3: DATA, seqno=122, conn_id=1, TP: [cluster_name=ISPN] 09:58:54,989 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #122, conn_id=1) 09:58:54,989 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#122 09:58:54,989 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90503 09:58:54,989 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:54,989 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:54,989 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:54,989 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:54,989 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:54,996 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@31455a] 09:58:54,999 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,000 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:55,001 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:55,003 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:55,006 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,006 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,006 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:55,015 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(148b6cbf){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,015 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,015 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,015 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(148b6cbf){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,015 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:55,021 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,024 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,024 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:55,028 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:55,030 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,030 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,030 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90503 to Test-NodeA-7051 09:58:55,030 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #124, conn_id=0) 09:58:55,031 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90503, rsp_expected=true, UNICAST3: DATA, seqno=124, TP: [cluster_name=ISPN] 09:58:55,031 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37525 09:58:55,031 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,031 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:55,031 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90503, rsp_expected=true, UNICAST3: DATA, seqno=124, TP: [cluster_name=ISPN] 09:58:55,031 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #124, conn_id=0) 09:58:55,031 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#124 09:58:55,031 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,031 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:55,031 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(44fae257){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,031 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:55,031 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,031 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,031 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:55,031 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:55,031 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,031 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:37525 09:58:55,031 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37525. 09:58:55,031 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37525}. ACQUIRED => RELEASED 09:58:55,031 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37525}? true 09:58:55,031 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37525} 09:58:55,031 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37525}, null) => true 09:58:55,031 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:55,031 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@65a55ae4] 09:58:55,031 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:55,031 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:55,031 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:55,031 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:55,031 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,032 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,032 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:55,032 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,032 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,032 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:55,032 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90511] on Test-NodeC-52778 09:58:55,032 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #214, conn_id=2) 09:58:55,032 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90511, rsp_expected=true, UNICAST3: DATA, seqno=214, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,032 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,032 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90511, rsp_expected=true, UNICAST3: DATA, seqno=214, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #214, conn_id=2) 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#214 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90511 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37529. timeout=10000 (MILLISECONDS) 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37529. Timeout=10000 (MILLISECONDS) 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37529} 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37529}. Current=null 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37529}) => true 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37529}. WAITING => ACQUIRED 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37529} successfully acquired the lock. 09:58:55,032 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4545eb7f] 09:58:55,032 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37529. timeout=10000 (MILLISECONDS) 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37529. Timeout=10000 (MILLISECONDS) 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37529} 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7d5dd312){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90512] on Test-NodeA-7051 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #217, conn_id=0) 09:58:55,033 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90512, rsp_expected=true, UNICAST3: DATA, seqno=217, TP: [cluster_name=ISPN] 09:58:55,033 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,033 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:55,033 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90512, rsp_expected=true, UNICAST3: DATA, seqno=217, TP: [cluster_name=ISPN] 09:58:55,033 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #217, conn_id=0) 09:58:55,033 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#217 09:58:55,038 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90512 09:58:55,038 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:55,043 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,043 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,043 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,044 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,044 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@29200c6d] 09:58:55,053 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,053 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:55,063 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:55,089 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:55,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,093 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4e566ee0){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4e566ee0){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90512 to Test-NodeC-52778 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #215, conn_id=2) 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90512, rsp_expected=true, UNICAST3: DATA, seqno=215, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,095 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37529 09:58:55,095 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,096 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:55,096 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90512, rsp_expected=true, UNICAST3: DATA, seqno=215, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,100 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #215, conn_id=2) 09:58:55,100 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#215 09:58:55,100 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,100 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:55,100 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7d5dd312){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,100 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:55,100 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,100 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37529 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37529. 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37529}. ACQUIRED => RELEASED 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37529}? true 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37529} 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37529}, null) => true 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,103 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90511 to Test-NodeA-7051 09:58:55,110 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #218, conn_id=0) 09:58:55,110 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90511, rsp_expected=true, UNICAST3: DATA, seqno=218, TP: [cluster_name=ISPN] 09:58:55,116 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,116 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37529 09:58:55,120 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:55,120 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90511, rsp_expected=true, UNICAST3: DATA, seqno=218, TP: [cluster_name=ISPN] 09:58:55,126 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #124) 09:58:55,127 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=124, ts=78, TP: [cluster_name=ISPN] 09:58:55,127 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #217) 09:58:55,127 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=217, ts=79, TP: [cluster_name=ISPN] 09:58:55,127 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:55,127 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:55,127 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:55,127 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=124, ts=78, TP: [cluster_name=ISPN] 09:58:55,127 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #124, conn-id=0, ts=78) 09:58:55,127 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=217, ts=79, TP: [cluster_name=ISPN] 09:58:55,127 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #217, conn-id=0, ts=79) 09:58:55,122 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #218, conn_id=0) 09:58:55,128 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#218 09:58:55,128 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,128 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:55,128 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,128 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1758a2d1] 09:58:55,128 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:55,128 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:55,128 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:55,128 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:55,128 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,128 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,128 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:55,128 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,128 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,128 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:55,128 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90526] on Test-NodeC-52778 09:58:55,128 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #216, conn_id=2) 09:58:55,128 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90526, rsp_expected=true, UNICAST3: DATA, seqno=216, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,128 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,128 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90526, rsp_expected=true, UNICAST3: DATA, seqno=216, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #216, conn_id=2) 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#216 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90526 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37536. timeout=10000 (MILLISECONDS) 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37536. Timeout=10000 (MILLISECONDS) 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37536} 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37536}. Current=null 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37536}) => true 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37536}. WAITING => ACQUIRED 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37536} successfully acquired the lock. 09:58:55,129 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,129 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,137 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #122) 09:58:55,137 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=122, conn_id=1, ts=67, TP: [cluster_name=ISPN] 09:58:55,137 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #53) 09:58:55,137 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=53, conn_id=1, ts=68, TP: [cluster_name=ISPN] 09:58:55,138 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #53) 09:58:55,143 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,143 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:55,138 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=53, conn_id=1, ts=69, TP: [cluster_name=ISPN] 09:58:55,146 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #216) 09:58:55,146 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=216, conn_id=2, ts=70, TP: [cluster_name=ISPN] 09:58:55,146 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=122, conn_id=1, ts=67, TP: [cluster_name=ISPN] 09:58:55,146 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #122, conn-id=1, ts=67) 09:58:55,148 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:55,148 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:55,148 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:55,148 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=53, conn_id=1, ts=69, TP: [cluster_name=ISPN] 09:58:55,148 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #53, conn-id=1, ts=69) 09:58:55,148 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=216, conn_id=2, ts=70, TP: [cluster_name=ISPN] 09:58:55,148 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #216, conn-id=2, ts=70) 09:58:55,149 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,149 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:55,161 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=53, conn_id=1, ts=68, TP: [cluster_name=ISPN] 09:58:55,161 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #53, conn-id=1, ts=68) 09:58:55,133 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,162 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3d899fe0] 09:58:55,162 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,162 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:55,162 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37536. timeout=10000 (MILLISECONDS) 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37536. Timeout=10000 (MILLISECONDS) 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37536} 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1a80a9d6){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:55,163 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90529] on Test-NodeA-7051 09:58:55,164 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #219, conn_id=0) 09:58:55,164 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90529, rsp_expected=true, UNICAST3: DATA, seqno=219, TP: [cluster_name=ISPN] 09:58:55,164 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,164 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:55,164 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90529, rsp_expected=true, UNICAST3: DATA, seqno=219, TP: [cluster_name=ISPN] 09:58:55,164 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #219, conn_id=0) 09:58:55,164 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#219 09:58:55,164 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90529 09:58:55,164 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:55,164 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,164 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4aa018b8] 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:55,164 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(27bfb7d0){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(27bfb7d0){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90529 to Test-NodeC-52778 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #217, conn_id=2) 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90529, rsp_expected=true, UNICAST3: DATA, seqno=217, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,165 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37536 09:58:55,165 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,165 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:55,166 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90529, rsp_expected=true, UNICAST3: DATA, seqno=217, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,166 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #217, conn_id=2) 09:58:55,166 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#217 09:58:55,166 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,166 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1a80a9d6){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37536 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37536. 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37536}. ACQUIRED => RELEASED 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37536}? true 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37536} 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37536}, null) => true 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,166 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90526 to Test-NodeA-7051 09:58:55,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #220, conn_id=0) 09:58:55,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90526, rsp_expected=true, UNICAST3: DATA, seqno=220, TP: [cluster_name=ISPN] 09:58:55,210 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37536 09:58:55,210 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,210 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:55,211 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90526, rsp_expected=true, UNICAST3: DATA, seqno=220, TP: [cluster_name=ISPN] 09:58:55,211 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #220, conn_id=0) 09:58:55,211 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#220 09:58:55,211 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,211 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:55,211 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,211 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1ce7784c] 09:58:55,211 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:55,211 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:55,211 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:55,211 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:55,211 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,211 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,211 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:55,211 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,211 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,211 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:55,211 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90534] on Test-NodeB-10318 09:58:55,211 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #123, conn_id=1) 09:58:55,211 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90534, rsp_expected=true, UNICAST3: DATA, seqno=123, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,211 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,214 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:55,216 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90534, rsp_expected=true, UNICAST3: DATA, seqno=123, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,216 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #123, conn_id=1) 09:58:55,216 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#123 09:58:55,216 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90534 09:58:55,216 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:55,226 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,227 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37543. timeout=10000 (MILLISECONDS) 09:58:55,227 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37543. Timeout=10000 (MILLISECONDS) 09:58:55,227 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37543} 09:58:55,227 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37543}. Current=null 09:58:55,227 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37543}) => true 09:58:55,227 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37543}. WAITING => ACQUIRED 09:58:55,227 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37543} successfully acquired the lock. 09:58:55,227 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,227 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,248 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@67afbd4d] 09:58:55,253 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37543. timeout=10000 (MILLISECONDS) 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37543. Timeout=10000 (MILLISECONDS) 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37543} 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,263 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(18d9fe1e){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90540] on Test-NodeC-52778 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #54, conn_id=1) 09:58:55,264 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90540, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,264 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,266 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:55,270 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90540, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,270 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #54, conn_id=1) 09:58:55,275 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#54 09:58:55,284 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90540 09:58:55,295 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:55,295 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,295 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@32becb5] 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(59a68d52){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(59a68d52){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90540 to Test-NodeB-10318 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #54, conn_id=1) 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90540, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,295 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37543 09:58:55,295 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,295 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:55,296 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90540, rsp_expected=true, UNICAST3: DATA, seqno=54, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,296 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #54, conn_id=1) 09:58:55,296 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#54 09:58:55,296 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,296 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(18d9fe1e){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37543 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37543. 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37543}. ACQUIRED => RELEASED 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37543}? true 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37543} 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37543}, null) => true 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90534 to Test-NodeA-7051 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #125, conn_id=0) 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90534, rsp_expected=true, UNICAST3: DATA, seqno=125, TP: [cluster_name=ISPN] 09:58:55,296 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37543 09:58:55,296 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,296 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:55,296 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90534, rsp_expected=true, UNICAST3: DATA, seqno=125, TP: [cluster_name=ISPN] 09:58:55,300 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #125, conn_id=0) 09:58:55,300 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#125 09:58:55,300 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,301 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:55,303 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,303 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3487cdce] 09:58:55,303 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:55,306 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:55,306 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:55,307 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:55,307 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,307 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,307 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:55,307 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,307 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,307 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:55,307 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90548] on Test-NodeC-52778 09:58:55,307 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #218, conn_id=2) 09:58:55,307 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90548, rsp_expected=true, UNICAST3: DATA, seqno=218, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,307 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,316 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90548, rsp_expected=true, UNICAST3: DATA, seqno=218, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #218, conn_id=2) 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#218 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90548 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37550. timeout=10000 (MILLISECONDS) 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37550. Timeout=10000 (MILLISECONDS) 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37550} 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37550}. Current=null 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37550}) => true 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37550}. WAITING => ACQUIRED 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37550} successfully acquired the lock. 09:58:55,321 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,321 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@12bfa0a5] 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37550. timeout=10000 (MILLISECONDS) 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37550. Timeout=10000 (MILLISECONDS) 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37550} 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7cbf6e61){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90552] on Test-NodeA-7051 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #221, conn_id=0) 09:58:55,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90552, rsp_expected=true, UNICAST3: DATA, seqno=221, TP: [cluster_name=ISPN] 09:58:55,334 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,334 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:55,340 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90552, rsp_expected=true, UNICAST3: DATA, seqno=221, TP: [cluster_name=ISPN] 09:58:55,341 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #221, conn_id=0) 09:58:55,341 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#221 09:58:55,341 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90552 09:58:55,341 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:55,341 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,341 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@e55842e] 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7309ca6a){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7309ca6a){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:55,341 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:55,342 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,356 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,357 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90552 to Test-NodeC-52778 09:58:55,357 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #219, conn_id=2) 09:58:55,357 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90552, rsp_expected=true, UNICAST3: DATA, seqno=219, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,357 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37550 09:58:55,359 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,360 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:55,368 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90552, rsp_expected=true, UNICAST3: DATA, seqno=219, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,369 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #219, conn_id=2) 09:58:55,369 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#219 09:58:55,386 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,386 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7cbf6e61){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37550 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37550. 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37550}. ACQUIRED => RELEASED 09:58:55,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37550}? true 09:58:55,407 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37550} 09:58:55,407 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37550}, null) => true 09:58:55,407 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:55,407 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,407 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90548 to Test-NodeA-7051 09:58:55,407 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #222, conn_id=0) 09:58:55,407 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90548, rsp_expected=true, UNICAST3: DATA, seqno=222, TP: [cluster_name=ISPN] 09:58:55,407 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37550 09:58:55,407 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,407 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:55,415 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90548, rsp_expected=true, UNICAST3: DATA, seqno=222, TP: [cluster_name=ISPN] 09:58:55,415 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #222, conn_id=0) 09:58:55,419 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#222 09:58:55,419 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,419 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:55,423 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,423 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:55,449 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:55,459 DEBUG (testng-Test:[]) [Test] Found key key-to-change1 with primary owner != Test-NodeA-7051, segment 184 09:58:55,459 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@408fc0c7] 09:58:55,459 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:55,459 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:55,459 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:55,459 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:58:55,459 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,459 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,459 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:55,459 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,459 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,459 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:55,459 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90566] on Test-NodeB-10318 09:58:55,459 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #124, conn_id=1) 09:58:55,459 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90566, rsp_expected=true, UNICAST3: DATA, seqno=124, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,459 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,459 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:55,459 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90566, rsp_expected=true, UNICAST3: DATA, seqno=124, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,460 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #124, conn_id=1) 09:58:55,496 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#124 09:58:55,524 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90566 09:58:55,526 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:55,526 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,538 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:37564. timeout=10000 (MILLISECONDS) 09:58:55,538 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37564. Timeout=10000 (MILLISECONDS) 09:58:55,538 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37564} 09:58:55,538 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37564}. Current=null 09:58:55,538 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37564}) => true 09:58:55,538 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37564}. WAITING => ACQUIRED 09:58:55,538 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37564} successfully acquired the lock. 09:58:55,538 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,538 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,538 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,554 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@546e2fd1] 09:58:55,554 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:37564. timeout=10000 (MILLISECONDS) 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37564. Timeout=10000 (MILLISECONDS) 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37564} 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(272fef29){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90580] on Test-NodeA-7051 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #126, conn_id=0) 09:58:55,555 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90580, rsp_expected=true, UNICAST3: DATA, seqno=126, TP: [cluster_name=ISPN] 09:58:55,555 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,559 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (210 bytes) 09:58:55,562 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90580, rsp_expected=true, UNICAST3: DATA, seqno=126, TP: [cluster_name=ISPN] 09:58:55,562 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #126, conn_id=0) 09:58:55,562 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#126 09:58:55,562 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90580 09:58:55,562 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:55,562 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,562 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@39a6796b] 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(63fd58b8){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(63fd58b8){key=key-to-change1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=initial-value} in container 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90580 to Test-NodeB-10318 09:58:55,563 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #125, conn_id=1) 09:58:55,566 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90580, rsp_expected=true, UNICAST3: DATA, seqno=125, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,566 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37564 09:58:55,567 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,567 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:55,567 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90580, rsp_expected=true, UNICAST3: DATA, seqno=125, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,567 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #125, conn_id=1) 09:58:55,567 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#125 09:58:55,578 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,578 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:55,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(272fef29){key=key-to-change1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:55,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:55,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:55,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:55,578 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:55,579 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=initial-value} in container 09:58:55,579 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,579 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:37564 09:58:55,584 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37564. 09:58:55,584 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37564}. ACQUIRED => RELEASED 09:58:55,584 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37564}? true 09:58:55,584 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37564} 09:58:55,585 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37564}, null) => true 09:58:55,585 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:55,594 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:55,594 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90566 to Test-NodeA-7051 09:58:55,597 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #127, conn_id=0) 09:58:55,601 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90566, rsp_expected=true, UNICAST3: DATA, seqno=127, TP: [cluster_name=ISPN] 09:58:55,601 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,601 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:55,601 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:37564 09:58:55,601 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90566, rsp_expected=true, UNICAST3: DATA, seqno=127, TP: [cluster_name=ISPN] 09:58:55,604 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #127, conn_id=0) 09:58:55,604 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#127 09:58:55,604 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,627 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #127) 09:58:55,627 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=127, ts=80, TP: [cluster_name=ISPN] 09:58:55,627 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #222) 09:58:55,627 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,627 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:55,627 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=127, ts=80, TP: [cluster_name=ISPN] 09:58:55,627 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #127, conn-id=0, ts=80) 09:58:55,604 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:55,627 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=222, ts=81, TP: [cluster_name=ISPN] 09:58:55,628 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,628 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:55,629 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=222, ts=81, TP: [cluster_name=ISPN] 09:58:55,629 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #222, conn-id=0, ts=81) 09:58:55,628 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:55,632 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1c07b09e] 09:58:55,632 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,632 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:55,632 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change1 for read. Entry=ImmortalCacheEntry{key=key-to-change1, value=initial-value} 09:58:55,635 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:55,635 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:55,635 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@104a0536] 09:58:55,635 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,635 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:55,635 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change1 for read. Entry=ImmortalCacheEntry{key=key-to-change1, value=initial-value} 09:58:55,635 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:55,635 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:55,635 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_close_iter_invoked * 1 09:58:55,636 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:55,636 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 4dae3642-a9db-4b6d-bbe7-71d027c95c93 09:58:55,642 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@432f1161[Not completed] to remote execution at node Test-NodeB-10318 09:58:55,646 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #54) 09:58:55,646 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=54, conn_id=1, ts=71, TP: [cluster_name=ISPN] 09:58:55,646 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #219) 09:58:55,646 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=219, conn_id=2, ts=72, TP: [cluster_name=ISPN] 09:58:55,646 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,646 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5aee6a2] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,649 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5aee6a2], mode=SYNCHRONOUS, timeout=15000 09:58:55,649 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5aee6a2] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:55,649 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90595] on Test-NodeB-10318 09:58:55,649 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #126, conn_id=1) 09:58:55,649 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90595, rsp_expected=true, UNICAST3: DATA, seqno=126, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,649 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,649 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:55,649 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5b3718b[Not completed] to remote execution at node Test-NodeC-52778 09:58:55,649 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5aee6a2] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,649 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5aee6a2], mode=SYNCHRONOUS, timeout=15000 09:58:55,649 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5aee6a2] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:55,649 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90596] on Test-NodeC-52778 09:58:55,649 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #220, conn_id=2) 09:58:55,649 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90595, rsp_expected=true, UNICAST3: DATA, seqno=126, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,649 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90596, rsp_expected=true, UNICAST3: DATA, seqno=220, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,649 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #126, conn_id=1) 09:58:55,649 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#126 09:58:55,649 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90595 09:58:55,650 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@515a59e8] [sender=Test-NodeA-7051] 09:58:55,650 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:55,650 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,650 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@515a59e8] 09:58:55,650 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 4dae3642-a9db-4b6d-bbe7-71d027c95c93 09:58:55,650 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@515a59e8] 09:58:55,650 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90595 to Test-NodeA-7051 09:58:55,650 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #128, conn_id=0) 09:58:55,650 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90595, rsp_expected=true, UNICAST3: DATA, seqno=128, TP: [cluster_name=ISPN] 09:58:55,649 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,651 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #126) 09:58:55,651 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=126, conn_id=1, ts=69, TP: [cluster_name=ISPN] 09:58:55,651 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #54) 09:58:55,651 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=54, conn_id=1, ts=70, TP: [cluster_name=ISPN] 09:58:55,651 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 3 msgs (198 bytes (990.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:55,652 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:55,652 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (97 bytes) 09:58:55,652 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received message batch of 1 messages from Test-NodeB-10318 09:58:55,652 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #126, conn-id=1, ts=69) 09:58:55,655 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=54, conn_id=1, ts=70, TP: [cluster_name=ISPN] 09:58:55,655 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #54, conn-id=1, ts=70) 09:58:55,652 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90595, rsp_expected=true, UNICAST3: DATA, seqno=128, TP: [cluster_name=ISPN] 09:58:55,656 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #128, conn_id=0) 09:58:55,656 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#128 09:58:55,656 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,656 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5aee6a2] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:55,648 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:55,661 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,661 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=54, conn_id=1, ts=71, TP: [cluster_name=ISPN] 09:58:55,661 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #54, conn-id=1, ts=71) 09:58:55,661 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:55,651 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:55,664 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=219, conn_id=2, ts=72, TP: [cluster_name=ISPN] 09:58:55,671 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #219, conn-id=2, ts=72) 09:58:55,668 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90596, rsp_expected=true, UNICAST3: DATA, seqno=220, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,674 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #220, conn_id=2) 09:58:55,676 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#220 09:58:55,676 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90596 09:58:55,676 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@73e639f8] [sender=Test-NodeA-7051] 09:58:55,678 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:55,678 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,678 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@73e639f8] 09:58:55,678 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 4dae3642-a9db-4b6d-bbe7-71d027c95c93 09:58:55,678 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@73e639f8] 09:58:55,678 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90596 to Test-NodeA-7051 09:58:55,678 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #223, conn_id=0) 09:58:55,678 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90596, rsp_expected=true, UNICAST3: DATA, seqno=223, TP: [cluster_name=ISPN] 09:58:55,678 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,680 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:55,680 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90596, rsp_expected=true, UNICAST3: DATA, seqno=223, TP: [cluster_name=ISPN] 09:58:55,680 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #223, conn_id=0) 09:58:55,682 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#223 09:58:55,685 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:55,685 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5aee6a2] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:55,685 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 4dae3642-a9db-4b6d-bbe7-71d027c95c93 requests initial state for cache 09:58:55,686 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7be1d8d0] 09:58:55,686 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:55,687 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:55,692 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705112 09:58:55,692 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705112 excluding keys [] 09:58:55,696 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,696 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:55,696 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:55,696 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:55,696 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90603] on Test-NodeB-10318 09:58:55,700 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #127, conn_id=1) 09:58:55,707 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90603, rsp_expected=true, UNICAST3: DATA, seqno=127, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,707 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,707 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:58:55,707 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90603, rsp_expected=true, UNICAST3: DATA, seqno=127, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,707 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #127, conn_id=1) 09:58:55,707 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#127 09:58:55,707 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90603 09:58:55,707 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:55,707 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,707 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,708 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:55,718 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705112 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:55,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@2fc7e47a] 09:58:55,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:55,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705112 09:58:55,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705112 09:58:55,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705112 09:58:55,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:55,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705112 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:55,720 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705112 09:58:55,720 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,720 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:55,720 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:55,720 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90606] on Test-NodeA-7051 09:58:55,720 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #129, conn_id=0) 09:58:55,720 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90606, rsp_expected=true, UNICAST3: DATA, seqno=129, TP: [cluster_name=ISPN] 09:58:55,721 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (258 bytes (1290.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,721 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (261 bytes) 09:58:55,721 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=184 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90606, rsp_expected=true, UNICAST3: DATA, seqno=129, TP: [cluster_name=ISPN] 09:58:55,721 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #129, conn_id=0) 09:58:55,721 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#129 09:58:55,721 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90606 09:58:55,721 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:55,721 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:55,721 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,721 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:55,721 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705112 with [] suspected segments. 09:58:55,728 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:55,729 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 3 09:58:55,729 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:55,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90606 to Test-NodeB-10318 09:58:55,730 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #128, conn_id=1) 09:58:55,735 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90606, rsp_expected=true, UNICAST3: DATA, seqno=128, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,735 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,735 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:55,735 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90606, rsp_expected=true, UNICAST3: DATA, seqno=128, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,735 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #128, conn_id=1) 09:58:55,735 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#128 09:58:55,735 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:55,735 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:55,735 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:55,735 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90603 to Test-NodeA-7051 09:58:55,735 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #130, conn_id=0) 09:58:55,735 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90603, rsp_expected=true, UNICAST3: DATA, seqno=130, TP: [cluster_name=ISPN] 09:58:55,737 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,737 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:55,738 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90603, rsp_expected=true, UNICAST3: DATA, seqno=130, TP: [cluster_name=ISPN] 09:58:55,738 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #130, conn_id=0) 09:58:55,738 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#130 09:58:55,738 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:55,738 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:55,738 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705112 excluding keys [] 09:58:55,747 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,750 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:55,751 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:55,751 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:55,753 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90612] on Test-NodeC-52778 09:58:55,753 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #221, conn_id=2) 09:58:55,753 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90612, rsp_expected=true, UNICAST3: DATA, seqno=221, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,753 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (607 bytes (3035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,753 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (610 bytes) 09:58:55,753 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90612, rsp_expected=true, UNICAST3: DATA, seqno=221, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,753 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #221, conn_id=2) 09:58:55,753 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#221 09:58:55,753 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90612 09:58:55,754 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:55,758 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,758 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,758 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:55,758 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705112 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:55,761 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@467a3cb5] 09:58:55,763 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:55,763 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705112 09:58:55,780 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705112 09:58:55,780 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705112 09:58:55,780 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:55,780 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705112 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:55,780 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705112 09:58:55,780 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,780 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:55,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:55,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90617] on Test-NodeA-7051 09:58:55,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #224, conn_id=0) 09:58:55,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90617, rsp_expected=true, UNICAST3: DATA, seqno=224, TP: [cluster_name=ISPN] 09:58:55,781 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (315 bytes (1575.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,781 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (318 bytes) 09:58:55,781 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=241 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90617, rsp_expected=true, UNICAST3: DATA, seqno=224, TP: [cluster_name=ISPN] 09:58:55,781 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #224, conn_id=0) 09:58:55,781 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#224 09:58:55,781 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90617 09:58:55,781 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:55,781 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:55,781 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,781 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:55,781 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705112 with [] suspected segments. 09:58:55,781 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:55,782 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:55,782 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705112 as completed! 09:58:55,782 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:55,782 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90617 to Test-NodeC-52778 09:58:55,782 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #222, conn_id=2) 09:58:55,787 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,787 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 129 09:58:55,787 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 130 09:58:55,788 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 131 09:58:55,788 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 4 09:58:55,788 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 132 09:58:55,788 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 133 09:58:55,782 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90617, rsp_expected=true, UNICAST3: DATA, seqno=222, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,788 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:55,788 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:55,788 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 135 09:58:55,791 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 8 09:58:55,788 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90617, rsp_expected=true, UNICAST3: DATA, seqno=222, conn_id=2, TP: [cluster_name=ISPN] 09:58:55,791 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #222, conn_id=2) 09:58:55,835 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#222 09:58:55,835 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:55,835 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:55,836 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:55,836 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90612 to Test-NodeA-7051 09:58:55,836 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #225, conn_id=0) 09:58:55,836 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90612, rsp_expected=true, UNICAST3: DATA, seqno=225, TP: [cluster_name=ISPN] 09:58:55,837 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,837 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:55,838 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90612, rsp_expected=true, UNICAST3: DATA, seqno=225, TP: [cluster_name=ISPN] 09:58:55,838 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #225, conn_id=0) 09:58:55,838 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#225 09:58:55,838 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:55,838 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:55,838 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:55,838 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-705112 09:58:55,838 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:55,838 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:55,839 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705112 09:58:55,839 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705112 being completed: true 09:58:55,839 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705112 09:58:55,791 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 10 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 139 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 14 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 15 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 16 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 18 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 19 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 147 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 148 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 21 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 151 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 153 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 30 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 158 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 31 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 159 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 164 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 40 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 41 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 45 09:58:55,864 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 47 09:58:55,868 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 180 09:58:55,869 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 181 09:58:55,879 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 60 09:58:55,879 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 63 09:58:55,887 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 67 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 195 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 69 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 201 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 74 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 203 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 76 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 205 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 78 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 81 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 82 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 210 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 83 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 85 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 86 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 90 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 219 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 93 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 94 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 222 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 96 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 224 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 98 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 99 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 227 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 228 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 103 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 107 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 108 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 236 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 239 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 240 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 113 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 241 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 245 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 119 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 120 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 249 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 122 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 124 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 253 09:58:55,893 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,893 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:55,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:55,900 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:55,902 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,902 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,918 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,930 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,930 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,930 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,930 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,930 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:55,930 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:55,930 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:55,930 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:55,930 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:55,930 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:55,930 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:55,930 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:55,931 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:55,931 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_close_iter_invoked * 1 (available = 1, total = 1) 09:58:55,933 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_close_iter_released * 1 09:58:55,934 TRACE (testng-Test:[]) [CheckPoint] Received event pre_close_iter_invoked * 1 (available = 0, total = 1) 09:58:55,936 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2236303d] 09:58:55,937 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id -1 09:58:55,937 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:55,937 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:55,945 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:58:55,945 TRACE (testng-Test:[]) [CallInterceptor] Invoking: RemoveCommand 09:58:55,945 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,945 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:55,945 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,945 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,945 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:55,945 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90636] on Test-NodeB-10318 09:58:55,945 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #129, conn_id=1) 09:58:55,945 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90636, rsp_expected=true, UNICAST3: DATA, seqno=129, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,945 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (172 bytes (860.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:55,945 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (175 bytes) 09:58:55,946 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=98 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90636, rsp_expected=true, UNICAST3: DATA, seqno=129, conn_id=1, TP: [cluster_name=ISPN] 09:58:55,946 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #129, conn_id=1) 09:58:55,946 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#129 09:58:55,954 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90636 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeA-7051] 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:37590. timeout=10000 (MILLISECONDS) 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37590. Timeout=10000 (MILLISECONDS) 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37590} 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37590}. Current=null 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37590}) => true 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37590}. WAITING => ACQUIRED 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37590} successfully acquired the lock. 09:58:55,960 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:55,960 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:55,960 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:58:55,960 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@28ddebb] 09:58:55,960 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:58:55,960 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:58:55,960 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:37590. timeout=10000 (MILLISECONDS) 09:58:55,964 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37590. Timeout=10000 (MILLISECONDS) 09:58:55,964 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37590} 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6534a131){key=key-to-change1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: RemoveCommand 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:55,965 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:55,985 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:58:55,985 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:55,985 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90640] on Test-NodeA-7051 09:58:55,985 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #131, conn_id=0) 09:58:55,985 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90640, rsp_expected=true, UNICAST3: DATA, seqno=131, TP: [cluster_name=ISPN] 09:58:55,985 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (172 bytes (860.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:55,985 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (175 bytes) 09:58:55,985 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=98 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90640, rsp_expected=true, UNICAST3: DATA, seqno=131, TP: [cluster_name=ISPN] 09:58:55,987 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #131, conn_id=0) 09:58:55,995 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#131 09:58:55,995 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90640 09:58:55,998 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeB-10318] 09:58:55,998 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:55,998 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:55,998 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,001 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@76ab4f0b] 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7f9af1fe){key=key-to-change1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:56,059 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: RemoveCommand 09:58:56,063 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,063 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7f9af1fe){key=key-to-change1, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:56,064 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:56,064 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,065 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:58:56,066 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:56,066 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:56,067 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90640 to Test-NodeB-10318 09:58:56,067 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #130, conn_id=1) 09:58:56,071 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90640, rsp_expected=true, UNICAST3: DATA, seqno=130, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,083 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37590 09:58:56,083 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:56,085 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (96 bytes) 09:58:56,085 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90640, rsp_expected=true, UNICAST3: DATA, seqno=130, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,087 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #130, conn_id=1) 09:58:56,087 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#130 09:58:56,088 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:56,093 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeA-7051=SuccessfulResponse{responseValue=initial-value} } 09:58:56,094 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6534a131){key=key-to-change1, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:56,094 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:58:56,096 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,096 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:58:56,096 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, key=key-to-change1, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:58:56,097 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@124df087[Not completed] to remote execution at node Test-NodeA-7051 09:58:56,098 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@5df9e753] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,098 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@5df9e753], mode=SYNCHRONOUS, timeout=15000 09:58:56,101 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@5df9e753] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:56,101 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90650] on Test-NodeA-7051 09:58:56,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #132, conn_id=0) 09:58:56,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90650, rsp_expected=true, UNICAST3: DATA, seqno=132, TP: [cluster_name=ISPN] 09:58:56,102 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (361 bytes (1805.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,102 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (364 bytes) 09:58:56,104 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=287 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90650, rsp_expected=true, UNICAST3: DATA, seqno=132, TP: [cluster_name=ISPN] 09:58:56,112 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #132, conn_id=0) 09:58:56,112 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#132 09:58:56,112 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90650 09:58:56,112 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@57dc106d] [sender=Test-NodeB-10318] 09:58:56,112 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:56,114 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,114 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@57dc106d] 09:58:56,117 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-10318}], notifying cluster listener with id 4dae3642-a9db-4b6d-bbe7-71d027c95c93 09:58:56,117 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Listener received event ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-10318} 09:58:56,119 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@57dc106d] 09:58:56,119 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90650 to Test-NodeB-10318 09:58:56,121 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #131, conn_id=1) 09:58:56,121 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90650, rsp_expected=true, UNICAST3: DATA, seqno=131, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,121 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:56,122 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:56,122 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90650, rsp_expected=true, UNICAST3: DATA, seqno=131, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,122 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #131, conn_id=1) 09:58:56,122 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#131 09:58:56,122 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,122 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@5df9e753] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:56,127 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:56,128 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:37590 09:58:56,128 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #132) 09:58:56,128 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=132, ts=82, TP: [cluster_name=ISPN] 09:58:56,134 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #225) 09:58:56,134 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=225, ts=83, TP: [cluster_name=ISPN] 09:58:56,134 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:56,134 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:56,134 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:56,128 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37590. 09:58:56,134 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37590}. ACQUIRED => RELEASED 09:58:56,134 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=132, ts=82, TP: [cluster_name=ISPN] 09:58:56,134 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #132, conn-id=0, ts=82) 09:58:56,134 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37590}? true 09:58:56,134 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=225, ts=83, TP: [cluster_name=ISPN] 09:58:56,135 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37590} 09:58:56,135 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37590}, null) => true 09:58:56,135 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:56,135 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:56,135 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #225, conn-id=0, ts=83) 09:58:56,135 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90636 to Test-NodeA-7051 09:58:56,147 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #222) 09:58:56,147 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=222, conn_id=2, ts=73, TP: [cluster_name=ISPN] 09:58:56,147 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,147 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:56,148 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=222, conn_id=2, ts=73, TP: [cluster_name=ISPN] 09:58:56,148 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #222, conn-id=2, ts=73) 09:58:56,137 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #133, conn_id=0) 09:58:56,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90636, rsp_expected=true, UNICAST3: DATA, seqno=133, TP: [cluster_name=ISPN] 09:58:56,151 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:37590 09:58:56,151 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,151 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:58:56,152 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #131) 09:58:56,152 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=131, conn_id=1, ts=71, TP: [cluster_name=ISPN] 09:58:56,155 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90636, rsp_expected=true, UNICAST3: DATA, seqno=133, TP: [cluster_name=ISPN] 09:58:56,155 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #133, conn_id=0) 09:58:56,155 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#133 09:58:56,155 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:56,155 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,155 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:58:56,156 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:56,156 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_close_iter_released * 999999999 (available = 999999999, total = 999999999) 09:58:56,156 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_close_iter_released * 1 (available = 999999998, total = 999999999) 09:58:56,156 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 4dae3642-a9db-4b6d-bbe7-71d027c95c93 initial state for cache completed 09:58:56,156 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:56,158 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:56,158 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:56,158 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@5ad84810[Not completed] to self 09:58:56,159 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@60eacf2a[Not completed] to remote execution at node Test-NodeB-10318 09:58:56,159 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5075e012] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,159 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5075e012], mode=SYNCHRONOUS, timeout=15000 09:58:56,159 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5075e012] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:56,159 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90658] on Test-NodeB-10318 09:58:56,159 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #132, conn_id=1) 09:58:56,159 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90658, rsp_expected=true, UNICAST3: DATA, seqno=132, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,159 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@3562865d[Not completed] to remote execution at node Test-NodeC-52778 09:58:56,160 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5075e012] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,160 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5075e012], mode=SYNCHRONOUS, timeout=15000 09:58:56,160 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5075e012] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:56,160 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90659] on Test-NodeC-52778 09:58:56,160 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #223, conn_id=2) 09:58:56,160 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90659, rsp_expected=true, UNICAST3: DATA, seqno=223, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,160 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (424 bytes (2120.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:56,160 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:56,160 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:56,160 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90658, rsp_expected=true, UNICAST3: DATA, seqno=132, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,160 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #132, conn_id=1) 09:58:56,160 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#132 09:58:56,160 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90658 09:58:56,160 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28bd510e] [sender=Test-NodeA-7051] 09:58:56,160 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:56,161 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90659, rsp_expected=true, UNICAST3: DATA, seqno=223, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,161 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #223, conn_id=2) 09:58:56,161 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#223 09:58:56,161 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90659 09:58:56,161 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@55a705d6] [sender=Test-NodeA-7051] 09:58:56,161 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:56,160 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,161 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,161 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@55a705d6] 09:58:56,161 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 4dae3642-a9db-4b6d-bbe7-71d027c95c93 09:58:56,155 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:56,167 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=131, conn_id=1, ts=71, TP: [cluster_name=ISPN] 09:58:56,171 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #131, conn-id=1, ts=71) 09:58:56,167 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28bd510e] 09:58:56,161 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@55a705d6] 09:58:56,171 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90659 to Test-NodeA-7051 09:58:56,171 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #226, conn_id=0) 09:58:56,171 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 4dae3642-a9db-4b6d-bbe7-71d027c95c93 09:58:56,171 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28bd510e] 09:58:56,171 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90658 to Test-NodeA-7051 09:58:56,171 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #134, conn_id=0) 09:58:56,173 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90658, rsp_expected=true, UNICAST3: DATA, seqno=134, TP: [cluster_name=ISPN] 09:58:56,171 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90659, rsp_expected=true, UNICAST3: DATA, seqno=226, TP: [cluster_name=ISPN] 09:58:56,173 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,173 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:56,173 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,175 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:56,177 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90658, rsp_expected=true, UNICAST3: DATA, seqno=134, TP: [cluster_name=ISPN] 09:58:56,177 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #134, conn_id=0) 09:58:56,177 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90659, rsp_expected=true, UNICAST3: DATA, seqno=226, TP: [cluster_name=ISPN] 09:58:56,181 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #226, conn_id=0) 09:58:56,181 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#134 09:58:56,182 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,188 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5075e012] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:56,182 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#226 09:58:56,188 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,194 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@5075e012] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:56,195 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndCompletedSegmentValueNonOwnerClustered 09:58:56,199 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:56,200 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:56,201 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:56,201 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:56,202 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:56,202 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:56,202 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:58:56,202 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:56,202 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:56,203 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:56,203 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:56,203 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:56,203 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:56,204 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:56,204 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndCompletedSegmentValueOwnerClustered 09:58:56,206 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@f5b3a8c] 09:58:56,206 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:56,206 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:56,206 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:56,206 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:56,206 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,206 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,206 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:56,206 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,206 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,207 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:56,207 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90664] on Test-NodeB-10318 09:58:56,207 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #133, conn_id=1) 09:58:56,207 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90664, rsp_expected=true, UNICAST3: DATA, seqno=133, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,207 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:56,207 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:56,207 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90664, rsp_expected=true, UNICAST3: DATA, seqno=133, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,207 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #133, conn_id=1) 09:58:56,207 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#133 09:58:56,207 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90664 09:58:56,207 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37606. timeout=10000 (MILLISECONDS) 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37606. Timeout=10000 (MILLISECONDS) 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37606} 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37606}. Current=null 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37606}) => true 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37606}. WAITING => ACQUIRED 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37606} successfully acquired the lock. 09:58:56,208 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,208 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,208 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,208 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5170e971] 09:58:56,209 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,212 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:56,213 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37606. timeout=10000 (MILLISECONDS) 09:58:56,213 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37606. Timeout=10000 (MILLISECONDS) 09:58:56,216 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37606} 09:58:56,227 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:56,227 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:56,227 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,227 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:56,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2b318188){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,236 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,237 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,237 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:56,239 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90671] on Test-NodeC-52778 09:58:56,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #55, conn_id=1) 09:58:56,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90671, rsp_expected=true, UNICAST3: DATA, seqno=55, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,240 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,240 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:56,243 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90671, rsp_expected=true, UNICAST3: DATA, seqno=55, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,244 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #55, conn_id=1) 09:58:56,244 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#55 09:58:56,245 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90671 09:58:56,246 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:56,246 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,247 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,247 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,247 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,248 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@598ba0bd] 09:58:56,250 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,251 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:56,252 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:56,252 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:56,253 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,254 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,254 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:56,256 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(28fcaf65){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,256 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,260 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,260 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(28fcaf65){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,260 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:56,262 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,263 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,266 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:56,266 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:56,266 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,267 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,267 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90671 to Test-NodeB-10318 09:58:56,267 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #55, conn_id=1) 09:58:56,267 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90671, rsp_expected=true, UNICAST3: DATA, seqno=55, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,268 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37606 09:58:56,268 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:56,269 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:56,269 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90671, rsp_expected=true, UNICAST3: DATA, seqno=55, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,270 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #55, conn_id=1) 09:58:56,270 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#55 09:58:56,273 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,277 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:56,277 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2b318188){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,277 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:56,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,278 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,279 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:56,279 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:56,284 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,286 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37606 09:58:56,286 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37606. 09:58:56,286 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37606}. ACQUIRED => RELEASED 09:58:56,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37606}? true 09:58:56,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37606} 09:58:56,289 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37606}, null) => true 09:58:56,291 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:56,292 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,292 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90664 to Test-NodeA-7051 09:58:56,292 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #135, conn_id=0) 09:58:56,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90664, rsp_expected=true, UNICAST3: DATA, seqno=135, TP: [cluster_name=ISPN] 09:58:56,293 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37606 09:58:56,295 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:56,295 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90664, rsp_expected=true, UNICAST3: DATA, seqno=135, TP: [cluster_name=ISPN] 09:58:56,295 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #135, conn_id=0) 09:58:56,295 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#135 09:58:56,295 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,297 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:56,298 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,298 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1cd915c2] 09:58:56,303 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:56,312 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:56,313 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:56,313 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:56,314 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,314 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,314 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:56,314 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,314 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,314 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:56,315 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90690] on Test-NodeC-52778 09:58:56,315 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #224, conn_id=2) 09:58:56,315 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90690, rsp_expected=true, UNICAST3: DATA, seqno=224, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,316 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,316 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:56,317 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90690, rsp_expected=true, UNICAST3: DATA, seqno=224, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,317 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #224, conn_id=2) 09:58:56,318 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#224 09:58:56,318 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90690 09:58:56,319 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:56,319 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,319 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37617. timeout=10000 (MILLISECONDS) 09:58:56,320 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37617. Timeout=10000 (MILLISECONDS) 09:58:56,320 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37617} 09:58:56,320 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37617}. Current=null 09:58:56,327 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37617}) => true 09:58:56,327 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37617}. WAITING => ACQUIRED 09:58:56,327 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37617} successfully acquired the lock. 09:58:56,334 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,334 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,336 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,337 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3ab82de8] 09:58:56,338 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,338 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:56,344 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37617. timeout=10000 (MILLISECONDS) 09:58:56,344 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37617. Timeout=10000 (MILLISECONDS) 09:58:56,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37617} 09:58:56,347 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:56,348 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:56,350 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,351 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,351 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:56,351 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2a03d9b8){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,352 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,352 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,352 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,352 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:56,361 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90701] on Test-NodeA-7051 09:58:56,362 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #227, conn_id=0) 09:58:56,362 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90701, rsp_expected=true, UNICAST3: DATA, seqno=227, TP: [cluster_name=ISPN] 09:58:56,363 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,363 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:56,364 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90701, rsp_expected=true, UNICAST3: DATA, seqno=227, TP: [cluster_name=ISPN] 09:58:56,364 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #227, conn_id=0) 09:58:56,364 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#227 09:58:56,364 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90701 09:58:56,364 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:56,364 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,364 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,364 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,364 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,364 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@50c76822] 09:58:56,365 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:56,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:56,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:56,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,369 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,369 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:56,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(78fa76c5){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,380 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(78fa76c5){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,380 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:56,382 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,382 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,383 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:56,383 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:56,384 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90701 to Test-NodeC-52778 09:58:56,389 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #225, conn_id=2) 09:58:56,389 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90701, rsp_expected=true, UNICAST3: DATA, seqno=225, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,389 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37617 09:58:56,389 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,390 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:56,390 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90701, rsp_expected=true, UNICAST3: DATA, seqno=225, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,390 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #225, conn_id=2) 09:58:56,390 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#225 09:58:56,390 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,390 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:56,390 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2a03d9b8){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,390 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37617 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37617. 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37617}. ACQUIRED => RELEASED 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37617}? true 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37617} 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37617}, null) => true 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90690 to Test-NodeA-7051 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #228, conn_id=0) 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90690, rsp_expected=true, UNICAST3: DATA, seqno=228, TP: [cluster_name=ISPN] 09:58:56,391 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37617 09:58:56,391 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,391 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:56,391 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90690, rsp_expected=true, UNICAST3: DATA, seqno=228, TP: [cluster_name=ISPN] 09:58:56,392 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #228, conn_id=0) 09:58:56,392 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#228 09:58:56,392 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,392 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:56,393 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,393 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2b6194a0] 09:58:56,393 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:56,393 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:56,394 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:56,394 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:56,394 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,394 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,394 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:56,394 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,394 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,394 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:56,394 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90709] on Test-NodeC-52778 09:58:56,394 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #226, conn_id=2) 09:58:56,394 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90709, rsp_expected=true, UNICAST3: DATA, seqno=226, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,394 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,399 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90709, rsp_expected=true, UNICAST3: DATA, seqno=226, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #226, conn_id=2) 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#226 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90709 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37629. timeout=10000 (MILLISECONDS) 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37629. Timeout=10000 (MILLISECONDS) 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37629} 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37629}. Current=null 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37629}) => true 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37629}. WAITING => ACQUIRED 09:58:56,399 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37629} successfully acquired the lock. 09:58:56,400 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@31eb9f86] 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37629. timeout=10000 (MILLISECONDS) 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37629. Timeout=10000 (MILLISECONDS) 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37629} 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(542f0949){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90711] on Test-NodeB-10318 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #56, conn_id=1) 09:58:56,400 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90711, rsp_expected=true, UNICAST3: DATA, seqno=56, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,400 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:56,400 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:56,400 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90711, rsp_expected=true, UNICAST3: DATA, seqno=56, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,400 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #56, conn_id=1) 09:58:56,400 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#56 09:58:56,400 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90711 09:58:56,400 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:56,403 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,407 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,408 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@67c10b84] 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(286cf827){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(286cf827){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90711 to Test-NodeC-52778 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #56, conn_id=1) 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90711, rsp_expected=true, UNICAST3: DATA, seqno=56, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37629 09:58:56,409 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,409 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:56,413 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90711, rsp_expected=true, UNICAST3: DATA, seqno=56, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,413 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #56, conn_id=1) 09:58:56,413 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#56 09:58:56,415 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,415 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:56,416 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(542f0949){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:56,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,419 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,419 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:56,419 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:56,419 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,419 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37629 09:58:56,419 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37629. 09:58:56,419 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37629}. ACQUIRED => RELEASED 09:58:56,420 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37629}? true 09:58:56,420 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37629} 09:58:56,420 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37629}, null) => true 09:58:56,420 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:56,422 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,422 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90709 to Test-NodeA-7051 09:58:56,424 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #229, conn_id=0) 09:58:56,424 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90709, rsp_expected=true, UNICAST3: DATA, seqno=229, TP: [cluster_name=ISPN] 09:58:56,424 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37629 09:58:56,424 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,428 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:56,428 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90709, rsp_expected=true, UNICAST3: DATA, seqno=229, TP: [cluster_name=ISPN] 09:58:56,429 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #229, conn_id=0) 09:58:56,429 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#229 09:58:56,429 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,430 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:56,430 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,430 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@77d99c36] 09:58:56,431 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:56,432 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:56,433 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:56,434 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:56,434 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,435 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,435 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:56,435 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,435 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,436 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:56,436 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90718] on Test-NodeC-52778 09:58:56,437 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #227, conn_id=2) 09:58:56,496 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90718, rsp_expected=true, UNICAST3: DATA, seqno=227, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,496 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,497 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:56,500 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90718, rsp_expected=true, UNICAST3: DATA, seqno=227, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,500 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #227, conn_id=2) 09:58:56,500 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#227 09:58:56,500 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90718 09:58:56,500 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:56,500 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,501 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37631. timeout=10000 (MILLISECONDS) 09:58:56,502 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37631. Timeout=10000 (MILLISECONDS) 09:58:56,502 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37631} 09:58:56,504 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37631}. Current=null 09:58:56,505 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37631}) => true 09:58:56,505 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37631}. WAITING => ACQUIRED 09:58:56,505 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37631} successfully acquired the lock. 09:58:56,512 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,512 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,512 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,517 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@65737a81] 09:58:56,528 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:56,529 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37631. timeout=10000 (MILLISECONDS) 09:58:56,530 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37631. Timeout=10000 (MILLISECONDS) 09:58:56,531 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37631} 09:58:56,532 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:56,533 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:56,534 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,535 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:56,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5670b81a){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,714 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:56,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90726] on Test-NodeB-10318 09:58:56,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #57, conn_id=1) 09:58:56,715 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90726, rsp_expected=true, UNICAST3: DATA, seqno=57, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,715 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:56,715 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:56,716 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90726, rsp_expected=true, UNICAST3: DATA, seqno=57, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,716 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #57, conn_id=1) 09:58:56,716 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#57 09:58:56,716 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90726 09:58:56,716 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:56,716 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,716 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@17676dc0] 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2bf9ebee){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2bf9ebee){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90726 to Test-NodeC-52778 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #57, conn_id=1) 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90726, rsp_expected=true, UNICAST3: DATA, seqno=57, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37631 09:58:56,716 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,717 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:56,723 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #135) 09:58:56,723 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=135, ts=84, TP: [cluster_name=ISPN] 09:58:56,730 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #229) 09:58:56,730 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=229, ts=85, TP: [cluster_name=ISPN] 09:58:56,731 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:56,731 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:56,719 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #133) 09:58:56,717 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90726, rsp_expected=true, UNICAST3: DATA, seqno=57, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,731 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #57, conn_id=1) 09:58:56,734 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=229, ts=85, TP: [cluster_name=ISPN] 09:58:56,734 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #229, conn-id=0, ts=85) 09:58:56,740 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #57) 09:58:56,731 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#57 09:58:56,742 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,742 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5670b81a){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37631 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37631. 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37631}. ACQUIRED => RELEASED 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37631}? true 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37631} 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37631}, null) => true 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90718 to Test-NodeA-7051 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #230, conn_id=0) 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90718, rsp_expected=true, UNICAST3: DATA, seqno=230, TP: [cluster_name=ISPN] 09:58:56,742 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37631 09:58:56,742 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,742 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:56,742 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90718, rsp_expected=true, UNICAST3: DATA, seqno=230, TP: [cluster_name=ISPN] 09:58:56,742 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #230, conn_id=0) 09:58:56,731 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=133, conn_id=1, ts=72, TP: [cluster_name=ISPN] 09:58:56,743 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #57) 09:58:56,731 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:56,743 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=135, ts=84, TP: [cluster_name=ISPN] 09:58:56,743 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #135, conn-id=0, ts=84) 09:58:56,743 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=57, conn_id=1, ts=73, TP: [cluster_name=ISPN] 09:58:56,742 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#230 09:58:56,755 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,755 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:56,755 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,755 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7b0952e1] 09:58:56,755 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:56,755 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:56,755 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:56,755 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:56,755 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,756 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,756 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:56,756 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,756 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,756 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:56,756 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90729] on Test-NodeC-52778 09:58:56,756 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #228, conn_id=2) 09:58:56,756 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90729, rsp_expected=true, UNICAST3: DATA, seqno=228, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,758 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,758 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90729, rsp_expected=true, UNICAST3: DATA, seqno=228, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #228, conn_id=2) 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#228 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90729 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37641. timeout=10000 (MILLISECONDS) 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37641. Timeout=10000 (MILLISECONDS) 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37641} 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37641}. Current=null 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37641}) => true 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37641}. WAITING => ACQUIRED 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37641} successfully acquired the lock. 09:58:56,759 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@254d2f6b] 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37641. timeout=10000 (MILLISECONDS) 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37641. Timeout=10000 (MILLISECONDS) 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37641} 09:58:56,759 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:56,765 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:56,765 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,765 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7fd59bcc){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90732] on Test-NodeA-7051 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #231, conn_id=0) 09:58:56,766 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90732, rsp_expected=true, UNICAST3: DATA, seqno=231, TP: [cluster_name=ISPN] 09:58:56,766 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,766 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:56,766 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90732, rsp_expected=true, UNICAST3: DATA, seqno=231, TP: [cluster_name=ISPN] 09:58:56,766 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #231, conn_id=0) 09:58:56,766 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#231 09:58:56,766 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90732 09:58:56,766 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:56,766 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,766 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,766 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6eab97cf] 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(57b75448){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(57b75448){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90732 to Test-NodeC-52778 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #229, conn_id=2) 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90732, rsp_expected=true, UNICAST3: DATA, seqno=229, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,767 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37641 09:58:56,767 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,767 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:56,770 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90732, rsp_expected=true, UNICAST3: DATA, seqno=229, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,770 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #229, conn_id=2) 09:58:56,770 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#229 09:58:56,770 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,771 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:56,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7fd59bcc){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:56,740 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=57, conn_id=1, ts=74, TP: [cluster_name=ISPN] 09:58:56,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,771 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #229) 09:58:56,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:56,771 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=229, conn_id=2, ts=75, TP: [cluster_name=ISPN] 09:58:56,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:56,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:56,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:56,773 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=229, conn_id=2, ts=75, TP: [cluster_name=ISPN] 09:58:56,773 TRACE (Timer-2,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:56,773 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:56,771 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37641 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37641. 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37641}. ACQUIRED => RELEASED 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37641}? true 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37641} 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37641}, null) => true 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90729 to Test-NodeA-7051 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #232, conn_id=0) 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90729, rsp_expected=true, UNICAST3: DATA, seqno=232, TP: [cluster_name=ISPN] 09:58:56,781 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37641 09:58:56,751 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,803 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:56,803 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (197 bytes (985.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:56,803 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:56,803 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:56,807 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=57, conn_id=1, ts=73, TP: [cluster_name=ISPN] 09:58:56,801 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,824 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:56,824 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90729, rsp_expected=true, UNICAST3: DATA, seqno=232, TP: [cluster_name=ISPN] 09:58:56,824 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #232, conn_id=0) 09:58:56,824 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#232 09:58:56,824 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,824 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:56,824 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,824 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@49977fe0] 09:58:56,824 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:56,824 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:56,824 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:37642. timeout=10000 (MILLISECONDS) 09:58:56,824 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37642. Timeout=10000 (MILLISECONDS) 09:58:56,824 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37642} 09:58:56,824 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37642}. Current=null 09:58:56,778 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=57, conn_id=1, ts=74, TP: [cluster_name=ISPN] 09:58:56,828 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #57, conn-id=1, ts=74) 09:58:56,777 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #229, conn-id=2, ts=75) 09:58:56,829 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:56,829 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeB-10318: mine: Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:56,824 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37642}) => true 09:58:56,842 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37642}. WAITING => ACQUIRED 09:58:56,842 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37642} successfully acquired the lock. 09:58:56,842 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:56,842 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:56,842 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,842 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,842 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:56,842 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(e32eadb){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,842 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,842 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,842 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:56,842 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,842 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,842 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:56,842 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90737] on Test-NodeB-10318 09:58:56,842 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #134, conn_id=1) 09:58:56,842 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90737, rsp_expected=true, UNICAST3: DATA, seqno=134, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,842 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:56,843 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:56,843 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90737, rsp_expected=true, UNICAST3: DATA, seqno=134, conn_id=1, TP: [cluster_name=ISPN] 09:58:56,843 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #134, conn_id=1) 09:58:56,843 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#134 09:58:56,843 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90737 09:58:56,843 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:56,843 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,843 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,808 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=133, conn_id=1, ts=72, TP: [cluster_name=ISPN] 09:58:56,807 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #57, conn-id=1, ts=73) 09:58:56,844 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,853 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #133, conn-id=1, ts=72) 09:58:56,866 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,881 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@448b583e] 09:58:56,881 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,884 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:56,884 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(b692d48){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(b692d48){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,887 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:56,887 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:56,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,896 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,896 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90737 to Test-NodeA-7051 09:58:56,896 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #136, conn_id=0) 09:58:56,897 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90737, rsp_expected=true, UNICAST3: DATA, seqno=136, TP: [cluster_name=ISPN] 09:58:56,898 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,898 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:56,898 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37642 09:58:56,898 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90737, rsp_expected=true, UNICAST3: DATA, seqno=136, TP: [cluster_name=ISPN] 09:58:56,906 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #136, conn_id=0) 09:58:56,906 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#136 09:58:56,906 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,906 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:56,906 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(e32eadb){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,913 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:56,914 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,921 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,921 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:56,922 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:56,922 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,923 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:37642 09:58:56,923 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37642. 09:58:56,923 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37642}. ACQUIRED => RELEASED 09:58:56,923 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37642}? true 09:58:56,924 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37642} 09:58:56,925 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37642}, null) => true 09:58:56,926 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:56,926 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@453a7268] 09:58:56,926 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:56,927 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:56,928 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:56,928 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:56,930 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,930 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,930 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:56,930 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,931 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,932 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:56,933 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90750] on Test-NodeC-52778 09:58:56,933 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #230, conn_id=2) 09:58:56,933 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90750, rsp_expected=true, UNICAST3: DATA, seqno=230, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,933 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,934 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:56,935 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90750, rsp_expected=true, UNICAST3: DATA, seqno=230, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,936 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #230, conn_id=2) 09:58:56,936 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#230 09:58:56,938 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90750 09:58:56,939 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:56,940 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,942 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37649. timeout=10000 (MILLISECONDS) 09:58:56,942 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37649. Timeout=10000 (MILLISECONDS) 09:58:56,943 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37649} 09:58:56,943 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37649}. Current=null 09:58:56,943 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37649}) => true 09:58:56,943 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37649}. WAITING => ACQUIRED 09:58:56,943 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37649} successfully acquired the lock. 09:58:56,943 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1c75e7b8] 09:58:56,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,943 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:56,944 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37649. timeout=10000 (MILLISECONDS) 09:58:56,944 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37649. Timeout=10000 (MILLISECONDS) 09:58:56,946 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37649} 09:58:56,946 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:56,946 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:56,946 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,947 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:56,948 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(208696c0){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,950 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,950 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,950 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:56,950 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:56,950 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:56,956 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90758] on Test-NodeA-7051 09:58:56,961 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #233, conn_id=0) 09:58:56,962 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90758, rsp_expected=true, UNICAST3: DATA, seqno=233, TP: [cluster_name=ISPN] 09:58:56,964 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:56,964 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:56,965 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90758, rsp_expected=true, UNICAST3: DATA, seqno=233, TP: [cluster_name=ISPN] 09:58:56,965 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #233, conn_id=0) 09:58:56,968 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#233 09:58:56,968 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90758 09:58:56,968 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:56,977 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:56,977 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,977 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:56,981 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:56,981 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3c5ab0e4] 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(17bdb5f4){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(17bdb5f4){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90758 to Test-NodeC-52778 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #231, conn_id=2) 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90758, rsp_expected=true, UNICAST3: DATA, seqno=231, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,982 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37649 09:58:56,982 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:56,982 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:56,984 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90758, rsp_expected=true, UNICAST3: DATA, seqno=231, conn_id=2, TP: [cluster_name=ISPN] 09:58:56,986 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #231, conn_id=2) 09:58:56,986 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#231 09:58:56,989 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:56,989 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:56,990 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(208696c0){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:56,996 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37649 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37649. 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37649}. ACQUIRED => RELEASED 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37649}? true 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37649} 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37649}, null) => true 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90750 to Test-NodeA-7051 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #234, conn_id=0) 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90750, rsp_expected=true, UNICAST3: DATA, seqno=234, TP: [cluster_name=ISPN] 09:58:57,001 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37649 09:58:57,001 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,009 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,010 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90750, rsp_expected=true, UNICAST3: DATA, seqno=234, TP: [cluster_name=ISPN] 09:58:57,010 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #234, conn_id=0) 09:58:57,026 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#234 09:58:57,026 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,028 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:57,028 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,037 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1832d21c] 09:58:57,037 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:57,043 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:57,043 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:57,048 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:57,048 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,048 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,048 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:57,048 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,048 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,048 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:57,048 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90773] on Test-NodeC-52778 09:58:57,048 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #232, conn_id=2) 09:58:57,048 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90773, rsp_expected=true, UNICAST3: DATA, seqno=232, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,048 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,053 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:57,059 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90773, rsp_expected=true, UNICAST3: DATA, seqno=232, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,059 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #232, conn_id=2) 09:58:57,062 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#232 09:58:57,062 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90773 09:58:57,062 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:57,062 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,066 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37657. timeout=10000 (MILLISECONDS) 09:58:57,066 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37657. Timeout=10000 (MILLISECONDS) 09:58:57,067 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37657} 09:58:57,067 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37657}. Current=null 09:58:57,067 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37657}) => true 09:58:57,068 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37657}. WAITING => ACQUIRED 09:58:57,068 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37657} successfully acquired the lock. 09:58:57,069 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,069 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,069 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,070 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@685a4fad] 09:58:57,071 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,072 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:57,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37657. timeout=10000 (MILLISECONDS) 09:58:57,074 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37657. Timeout=10000 (MILLISECONDS) 09:58:57,075 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37657} 09:58:57,075 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:57,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:57,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,077 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,077 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:57,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5b45e4c){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,079 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:57,080 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90781] on Test-NodeA-7051 09:58:57,081 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #235, conn_id=0) 09:58:57,081 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90781, rsp_expected=true, UNICAST3: DATA, seqno=235, TP: [cluster_name=ISPN] 09:58:57,081 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,081 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:57,081 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90781, rsp_expected=true, UNICAST3: DATA, seqno=235, TP: [cluster_name=ISPN] 09:58:57,082 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #235, conn_id=0) 09:58:57,083 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#235 09:58:57,083 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90781 09:58:57,085 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:57,086 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,086 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,086 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,086 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,086 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@251a4d23] 09:58:57,087 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,088 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:57,096 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:57,097 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:57,098 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,101 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,101 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:57,101 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(486258dc){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,102 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,103 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,103 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(486258dc){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,103 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:57,104 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,104 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,107 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:57,107 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:57,108 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,108 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,108 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90781 to Test-NodeC-52778 09:58:57,111 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #233, conn_id=2) 09:58:57,111 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90781, rsp_expected=true, UNICAST3: DATA, seqno=233, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,111 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,111 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37657 09:58:57,112 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:57,115 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90781, rsp_expected=true, UNICAST3: DATA, seqno=233, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,115 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #233, conn_id=2) 09:58:57,115 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#233 09:58:57,115 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,115 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5b45e4c){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37657 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37657. 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37657}. ACQUIRED => RELEASED 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37657}? true 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37657} 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37657}, null) => true 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90773 to Test-NodeA-7051 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #236, conn_id=0) 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90773, rsp_expected=true, UNICAST3: DATA, seqno=236, TP: [cluster_name=ISPN] 09:58:57,115 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,124 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,124 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90773, rsp_expected=true, UNICAST3: DATA, seqno=236, TP: [cluster_name=ISPN] 09:58:57,124 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #236, conn_id=0) 09:58:57,124 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#236 09:58:57,124 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,124 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:57,124 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,115 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37657 09:58:57,124 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@54867b9f] 09:58:57,127 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:57,129 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:57,129 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:57,130 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:57,130 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,130 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,131 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:57,132 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,132 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,132 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:57,132 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90790] on Test-NodeB-10318 09:58:57,133 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #135, conn_id=1) 09:58:57,133 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90790, rsp_expected=true, UNICAST3: DATA, seqno=135, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,133 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,133 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90790, rsp_expected=true, UNICAST3: DATA, seqno=135, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #135, conn_id=1) 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#135 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90790 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37668. timeout=10000 (MILLISECONDS) 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37668. Timeout=10000 (MILLISECONDS) 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37668} 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37668}. Current=null 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37668}) => true 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37668}. WAITING => ACQUIRED 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37668} successfully acquired the lock. 09:58:57,133 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,133 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,133 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,133 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@274c5888] 09:58:57,134 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,134 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:57,135 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37668. timeout=10000 (MILLISECONDS) 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37668. Timeout=10000 (MILLISECONDS) 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37668} 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(430e7114){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90791] on Test-NodeC-52778 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #58, conn_id=1) 09:58:57,136 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90791, rsp_expected=true, UNICAST3: DATA, seqno=58, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,136 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,136 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:57,150 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90791, rsp_expected=true, UNICAST3: DATA, seqno=58, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,150 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #58, conn_id=1) 09:58:57,150 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#58 09:58:57,150 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90791 09:58:57,150 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:57,154 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,161 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,162 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,162 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,162 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@316de529] 09:58:57,164 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,169 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:57,169 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:57,172 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:57,173 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,174 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,174 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:57,176 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(cf5446f){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,176 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,176 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,177 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(cf5446f){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,177 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:57,177 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,177 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,177 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:57,177 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:57,178 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,178 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,179 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90791 to Test-NodeB-10318 09:58:57,179 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #58, conn_id=1) 09:58:57,179 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90791, rsp_expected=true, UNICAST3: DATA, seqno=58, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,179 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37668 09:58:57,179 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,179 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:57,179 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90791, rsp_expected=true, UNICAST3: DATA, seqno=58, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,180 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #58, conn_id=1) 09:58:57,180 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#58 09:58:57,180 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,180 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:57,180 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(430e7114){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,181 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:57,181 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,181 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,182 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:57,182 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:57,186 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,188 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37668 09:58:57,190 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37668. 09:58:57,191 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37668}. ACQUIRED => RELEASED 09:58:57,191 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37668}? true 09:58:57,191 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37668} 09:58:57,191 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37668}, null) => true 09:58:57,191 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:57,191 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,191 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90790 to Test-NodeA-7051 09:58:57,194 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #137, conn_id=0) 09:58:57,194 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90790, rsp_expected=true, UNICAST3: DATA, seqno=137, TP: [cluster_name=ISPN] 09:58:57,195 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37668 09:58:57,195 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,195 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,199 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90790, rsp_expected=true, UNICAST3: DATA, seqno=137, TP: [cluster_name=ISPN] 09:58:57,199 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #137, conn_id=0) 09:58:57,200 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#137 09:58:57,200 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,200 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:57,200 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,200 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@56d257c4] 09:58:57,200 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:57,201 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:57,201 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:57,201 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:57,201 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,201 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,201 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:57,201 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,201 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,201 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:57,201 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90807] on Test-NodeC-52778 09:58:57,201 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #234, conn_id=2) 09:58:57,201 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90807, rsp_expected=true, UNICAST3: DATA, seqno=234, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,201 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,201 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:57,210 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90807, rsp_expected=true, UNICAST3: DATA, seqno=234, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,218 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #234, conn_id=2) 09:58:57,218 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#234 09:58:57,220 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90807 09:58:57,220 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:57,220 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,223 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37679. timeout=10000 (MILLISECONDS) 09:58:57,223 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37679. Timeout=10000 (MILLISECONDS) 09:58:57,224 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37679} 09:58:57,224 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37679}. Current=null 09:58:57,227 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37679}) => true 09:58:57,227 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37679}. WAITING => ACQUIRED 09:58:57,228 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37679} successfully acquired the lock. 09:58:57,229 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1d68420f] 09:58:57,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,229 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:57,230 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37679. timeout=10000 (MILLISECONDS) 09:58:57,231 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #137) 09:58:57,230 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37679. Timeout=10000 (MILLISECONDS) 09:58:57,231 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=137, ts=86, TP: [cluster_name=ISPN] 09:58:57,231 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #236) 09:58:57,231 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=236, ts=87, TP: [cluster_name=ISPN] 09:58:57,231 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:57,231 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:57,231 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:57,231 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=236, ts=87, TP: [cluster_name=ISPN] 09:58:57,231 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #236, conn-id=0, ts=87) 09:58:57,231 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=137, ts=86, TP: [cluster_name=ISPN] 09:58:57,231 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37679} 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(393fad27){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90814] on Test-NodeA-7051 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #237, conn_id=0) 09:58:57,232 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90814, rsp_expected=true, UNICAST3: DATA, seqno=237, TP: [cluster_name=ISPN] 09:58:57,232 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,232 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:57,232 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90814, rsp_expected=true, UNICAST3: DATA, seqno=237, TP: [cluster_name=ISPN] 09:58:57,232 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #237, conn_id=0) 09:58:57,233 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #137, conn-id=0, ts=86) 09:58:57,232 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#237 09:58:57,234 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90814 09:58:57,234 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:57,235 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,235 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,235 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,235 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,235 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21d60ca4] 09:58:57,235 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,235 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:57,235 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:57,237 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:57,253 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #135) 09:58:57,258 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=135, conn_id=1, ts=74, TP: [cluster_name=ISPN] 09:58:57,258 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,262 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:57,258 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #58) 09:58:57,253 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,262 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,262 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:57,262 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5b3e1f7f){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,262 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,262 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,262 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=135, conn_id=1, ts=74, TP: [cluster_name=ISPN] 09:58:57,262 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=58, conn_id=1, ts=75, TP: [cluster_name=ISPN] 09:58:57,263 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #135, conn-id=1, ts=74) 09:58:57,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5b3e1f7f){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:57,268 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,269 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:57,271 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #58) 09:58:57,271 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=58, conn_id=1, ts=76, TP: [cluster_name=ISPN] 09:58:57,271 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #234) 09:58:57,271 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=234, conn_id=2, ts=77, TP: [cluster_name=ISPN] 09:58:57,271 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,271 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:57,271 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,271 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:57,271 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=58, conn_id=1, ts=76, TP: [cluster_name=ISPN] 09:58:57,271 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #58, conn-id=1, ts=76) 09:58:57,271 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=234, conn_id=2, ts=77, TP: [cluster_name=ISPN] 09:58:57,281 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #234, conn-id=2, ts=77) 09:58:57,269 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=58, conn_id=1, ts=75, TP: [cluster_name=ISPN] 09:58:57,282 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #58, conn-id=1, ts=75) 09:58:57,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,286 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:57,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:57,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,296 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90814 to Test-NodeC-52778 09:58:57,300 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #235, conn_id=2) 09:58:57,300 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90814, rsp_expected=true, UNICAST3: DATA, seqno=235, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,301 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37679 09:58:57,301 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,301 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:57,301 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90814, rsp_expected=true, UNICAST3: DATA, seqno=235, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,305 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #235, conn_id=2) 09:58:57,305 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#235 09:58:57,305 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,305 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(393fad27){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37679 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37679. 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37679}. ACQUIRED => RELEASED 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37679}? true 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37679} 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37679}, null) => true 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,305 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90807 to Test-NodeA-7051 09:58:57,306 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #238, conn_id=0) 09:58:57,306 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90807, rsp_expected=true, UNICAST3: DATA, seqno=238, TP: [cluster_name=ISPN] 09:58:57,306 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37679 09:58:57,306 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,306 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,308 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90807, rsp_expected=true, UNICAST3: DATA, seqno=238, TP: [cluster_name=ISPN] 09:58:57,308 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #238, conn_id=0) 09:58:57,312 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#238 09:58:57,318 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,319 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:57,320 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,321 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:57,342 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:57,344 DEBUG (testng-Test:[]) [Test] Found key key-to-change0 with primary owner Test-NodeA-7051, segment 51 09:58:57,344 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@767c8da1] 09:58:57,344 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:57,349 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:58:57,349 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:37692. timeout=10000 (MILLISECONDS) 09:58:57,351 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37692. Timeout=10000 (MILLISECONDS) 09:58:57,351 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37692} 09:58:57,352 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37692}. Current=null 09:58:57,352 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37692}) => true 09:58:57,352 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37692}. WAITING => ACQUIRED 09:58:57,352 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37692} successfully acquired the lock. 09:58:57,352 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:57,352 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:57,352 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,352 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,352 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:57,352 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(62ca9f80){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,352 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,352 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,352 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:57,352 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,353 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,353 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:57,353 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90829] on Test-NodeB-10318 09:58:57,353 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #136, conn_id=1) 09:58:57,353 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90829, rsp_expected=true, UNICAST3: DATA, seqno=136, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,353 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,353 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:58:57,361 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90829, rsp_expected=true, UNICAST3: DATA, seqno=136, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,361 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #136, conn_id=1) 09:58:57,361 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#136 09:58:57,361 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90829 09:58:57,362 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:57,362 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,362 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2344d8bb] 09:58:57,362 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,366 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:58:57,366 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:57,366 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:57,367 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,368 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,368 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:57,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4a936fd0){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,369 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,370 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4a936fd0){key=key-to-change0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,373 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:57,373 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,374 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,374 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:57,374 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=initial-value} in container 09:58:57,380 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,380 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,380 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90829 to Test-NodeA-7051 09:58:57,380 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #138, conn_id=0) 09:58:57,381 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90829, rsp_expected=true, UNICAST3: DATA, seqno=138, TP: [cluster_name=ISPN] 09:58:57,381 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,381 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,381 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37692 09:58:57,382 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90829, rsp_expected=true, UNICAST3: DATA, seqno=138, TP: [cluster_name=ISPN] 09:58:57,383 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #138, conn_id=0) 09:58:57,383 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#138 09:58:57,383 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,383 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:57,385 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(62ca9f80){key=key-to-change0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,385 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:57,385 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,385 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,385 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:57,385 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=initial-value} in container 09:58:57,385 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,385 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:37692 09:58:57,385 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37692. 09:58:57,385 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37692}. ACQUIRED => RELEASED 09:58:57,385 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37692}? true 09:58:57,385 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37692} 09:58:57,385 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37692}, null) => true 09:58:57,385 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:57,385 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@151e1453] 09:58:57,385 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,385 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:57,385 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change0 for read. Entry=ImmortalCacheEntry{key=key-to-change0, value=initial-value} 09:58:57,385 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:57,385 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:57,385 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3f432f77] 09:58:57,385 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,385 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:57,385 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change0 for read. Entry=ImmortalCacheEntry{key=key-to-change0, value=initial-value} 09:58:57,385 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:57,385 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:57,385 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_close_iter_invoked * 1 09:58:57,385 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:58:57,394 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 9f3cc66b-64a5-4486-973c-646b1e7b4424 09:58:57,394 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@558c04c7[Not completed] to remote execution at node Test-NodeB-10318 09:58:57,394 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4607ca14] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,394 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4607ca14], mode=SYNCHRONOUS, timeout=15000 09:58:57,394 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4607ca14] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:57,395 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90842] on Test-NodeB-10318 09:58:57,398 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #137, conn_id=1) 09:58:57,398 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90842, rsp_expected=true, UNICAST3: DATA, seqno=137, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,398 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,398 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:57,398 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@65d6b87e[Not completed] to remote execution at node Test-NodeC-52778 09:58:57,398 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4607ca14] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,398 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4607ca14], mode=SYNCHRONOUS, timeout=15000 09:58:57,398 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4607ca14] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:57,398 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90844] on Test-NodeC-52778 09:58:57,398 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #236, conn_id=2) 09:58:57,398 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90844, rsp_expected=true, UNICAST3: DATA, seqno=236, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,398 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,398 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:57,399 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90844, rsp_expected=true, UNICAST3: DATA, seqno=236, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,399 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #236, conn_id=2) 09:58:57,400 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90842, rsp_expected=true, UNICAST3: DATA, seqno=137, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,399 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#236 09:58:57,401 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90844 09:58:57,401 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #137, conn_id=1) 09:58:57,401 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#137 09:58:57,403 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5c7e38ee] [sender=Test-NodeA-7051] 09:58:57,402 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90842 09:58:57,403 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5c739b04] [sender=Test-NodeA-7051] 09:58:57,403 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:57,404 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5c7e38ee] 09:58:57,404 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 9f3cc66b-64a5-4486-973c-646b1e7b4424 09:58:57,404 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,404 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:57,405 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5c739b04] 09:58:57,405 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,404 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5c7e38ee] 09:58:57,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90844 to Test-NodeA-7051 09:58:57,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #239, conn_id=0) 09:58:57,406 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90844, rsp_expected=true, UNICAST3: DATA, seqno=239, TP: [cluster_name=ISPN] 09:58:57,406 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,406 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,407 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90844, rsp_expected=true, UNICAST3: DATA, seqno=239, TP: [cluster_name=ISPN] 09:58:57,407 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #239, conn_id=0) 09:58:57,405 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 9f3cc66b-64a5-4486-973c-646b1e7b4424 09:58:57,408 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5c739b04] 09:58:57,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90842 to Test-NodeA-7051 09:58:57,407 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#239 09:58:57,409 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,409 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #139, conn_id=0) 09:58:57,410 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4607ca14] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:57,410 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90842, rsp_expected=true, UNICAST3: DATA, seqno=139, TP: [cluster_name=ISPN] 09:58:57,411 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,411 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,411 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90842, rsp_expected=true, UNICAST3: DATA, seqno=139, TP: [cluster_name=ISPN] 09:58:57,414 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #139, conn_id=0) 09:58:57,414 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#139 09:58:57,414 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,414 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4607ca14] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:57,501 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 9f3cc66b-64a5-4486-973c-646b1e7b4424 requests initial state for cache 09:58:57,501 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@3cac9b44] 09:58:57,502 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:57,503 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:57,509 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705113 09:58:57,509 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705113 excluding keys [] 09:58:57,509 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,509 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:57,511 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:57,512 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:57,514 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90849] on Test-NodeB-10318 09:58:57,518 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #138, conn_id=1) 09:58:57,518 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90849, rsp_expected=true, UNICAST3: DATA, seqno=138, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,518 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,519 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:58:57,529 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90849, rsp_expected=true, UNICAST3: DATA, seqno=138, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,529 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #138, conn_id=1) 09:58:57,529 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#138 09:58:57,529 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90849 09:58:57,529 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:57,529 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,529 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,529 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:57,531 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705113 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:57,531 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@2114333a] 09:58:57,531 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:57,531 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705113 09:58:57,536 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705113 09:58:57,538 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705113 09:58:57,538 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:57,545 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705113 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:57,546 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705113 09:58:57,547 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,548 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:57,550 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:57,550 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90858] on Test-NodeA-7051 09:58:57,550 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #140, conn_id=0) 09:58:57,550 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90858, rsp_expected=true, UNICAST3: DATA, seqno=140, TP: [cluster_name=ISPN] 09:58:57,550 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (225 bytes (1125.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,551 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (228 bytes) 09:58:57,552 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=151 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90858, rsp_expected=true, UNICAST3: DATA, seqno=140, TP: [cluster_name=ISPN] 09:58:57,553 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #140, conn_id=0) 09:58:57,553 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#140 09:58:57,553 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90858 09:58:57,553 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:57,554 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:57,555 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,555 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:57,555 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705113 with [] suspected segments. 09:58:57,555 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:57,555 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:57,555 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:57,555 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90858 to Test-NodeB-10318 09:58:57,555 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #139, conn_id=1) 09:58:57,556 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90858, rsp_expected=true, UNICAST3: DATA, seqno=139, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,556 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,564 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:57,564 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90858, rsp_expected=true, UNICAST3: DATA, seqno=139, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,564 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #139, conn_id=1) 09:58:57,564 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#139 09:58:57,564 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:57,564 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:57,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:57,564 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90849 to Test-NodeA-7051 09:58:57,566 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #141, conn_id=0) 09:58:57,567 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90849, rsp_expected=true, UNICAST3: DATA, seqno=141, TP: [cluster_name=ISPN] 09:58:57,567 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,567 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:57,574 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90849, rsp_expected=true, UNICAST3: DATA, seqno=141, TP: [cluster_name=ISPN] 09:58:57,574 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #141, conn_id=0) 09:58:57,574 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#141 09:58:57,575 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:57,583 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:57,583 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705113 excluding keys [] 09:58:57,584 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,585 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:57,585 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:57,585 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:57,586 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90867] on Test-NodeC-52778 09:58:57,586 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #237, conn_id=2) 09:58:57,587 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90867, rsp_expected=true, UNICAST3: DATA, seqno=237, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,587 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (607 bytes (3035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,587 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (610 bytes) 09:58:57,588 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90867, rsp_expected=true, UNICAST3: DATA, seqno=237, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,590 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #237, conn_id=2) 09:58:57,590 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#237 09:58:57,590 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90867 09:58:57,594 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:57,596 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,597 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,597 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:57,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705113 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:57,598 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7b84bd97] 09:58:57,600 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:57,603 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,602 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705113 09:58:57,604 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705113 09:58:57,604 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705113 09:58:57,605 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:57,608 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705113 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:57,608 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705113 09:58:57,603 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:58:57,609 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:58:57,609 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:58:57,608 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,611 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:57,610 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:58:57,613 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:58:57,614 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:57,614 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90873] on Test-NodeA-7051 09:58:57,618 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:58:57,618 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:58:57,620 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #240, conn_id=0) 09:58:57,620 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90873, rsp_expected=true, UNICAST3: DATA, seqno=240, TP: [cluster_name=ISPN] 09:58:57,619 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:58:57,623 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:58:57,621 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (315 bytes (1575.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,624 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (318 bytes) 09:58:57,623 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:58:57,626 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:58:57,625 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=241 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90873, rsp_expected=true, UNICAST3: DATA, seqno=240, TP: [cluster_name=ISPN] 09:58:57,627 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #240, conn_id=0) 09:58:57,627 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#240 09:58:57,627 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:58:57,628 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:58:57,628 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:58:57,627 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90873 09:58:57,628 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:57,628 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:57,629 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,628 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:58:57,629 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:58:57,629 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:57,630 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705113 with [] suspected segments. 09:58:57,630 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:57,630 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:58:57,630 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:58:57,631 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705113 as completed! 09:58:57,631 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:57,631 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90873 to Test-NodeC-52778 09:58:57,631 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #238, conn_id=2) 09:58:57,632 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:58:57,631 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90873, rsp_expected=true, UNICAST3: DATA, seqno=238, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,632 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,632 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (79 bytes) 09:58:57,632 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:58:57,633 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:58:57,633 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:58:57,633 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90873, rsp_expected=true, UNICAST3: DATA, seqno=238, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,634 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #238, conn_id=2) 09:58:57,635 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#238 09:58:57,635 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:57,635 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:57,635 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:57,635 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90867 to Test-NodeA-7051 09:58:57,635 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #241, conn_id=0) 09:58:57,635 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90867, rsp_expected=true, UNICAST3: DATA, seqno=241, TP: [cluster_name=ISPN] 09:58:57,635 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,635 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:57,635 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90867, rsp_expected=true, UNICAST3: DATA, seqno=241, TP: [cluster_name=ISPN] 09:58:57,635 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #241, conn_id=0) 09:58:57,635 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#241 09:58:57,635 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:57,635 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:57,636 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:57,636 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 2 for id Test-NodeA-705113 09:58:57,636 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:57,636 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 2 09:58:57,636 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705113 09:58:57,636 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705113 being completed: true 09:58:57,636 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705113 09:58:57,640 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:58:57,640 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:58:57,645 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:58:57,647 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:58:57,648 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:58:57,651 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:58:57,651 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:58:57,653 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:58:57,653 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:58:57,660 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:58:57,660 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:58:57,664 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:58:57,664 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:58:57,668 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:58:57,669 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:58:57,669 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:58:57,669 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:58:57,669 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:58:57,676 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:58:57,677 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:58:57,678 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:57,678 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:58:57,679 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:58:57,679 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:58:57,679 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change0, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:57,680 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:57,680 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_close_iter_invoked * 1 (available = 1, total = 1) 09:58:57,680 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_close_iter_released * 1 09:58:57,680 TRACE (testng-Test:[]) [CheckPoint] Received event pre_close_iter_invoked * 1 (available = 0, total = 1) 09:58:57,681 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1b34c180] 09:58:57,687 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id -1 09:58:57,687 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:58:57,687 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:37717. timeout=10000 (MILLISECONDS) 09:58:57,689 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37717. Timeout=10000 (MILLISECONDS) 09:58:57,689 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37717} 09:58:57,689 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37717}. Current=null 09:58:57,689 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37717}) => true 09:58:57,689 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37717}. WAITING => ACQUIRED 09:58:57,689 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37717} successfully acquired the lock. 09:58:57,689 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:57,689 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:57,689 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,689 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:57,689 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:57,689 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(c2c647d){key=key-to-change0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:57,689 TRACE (testng-Test:[]) [CallInterceptor] Invoking: RemoveCommand 09:58:57,689 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,689 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:57,689 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,689 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,689 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:57,689 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90892] on Test-NodeB-10318 09:58:57,689 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #140, conn_id=1) 09:58:57,689 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90892, rsp_expected=true, UNICAST3: DATA, seqno=140, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,695 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (172 bytes (860.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,695 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (175 bytes) 09:58:57,700 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=98 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90892, rsp_expected=true, UNICAST3: DATA, seqno=140, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,700 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #140, conn_id=1) 09:58:57,700 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#140 09:58:57,700 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90892 09:58:57,700 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeA-7051] 09:58:57,700 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:57,700 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,700 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:58:57,702 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5291fb65] 09:58:57,703 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:58:57,703 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:58:57,707 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:57,707 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:58:57,707 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,707 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:57,707 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:58:57,708 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3b954b23){key=key-to-change0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:57,709 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: RemoveCommand 09:58:57,710 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,711 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3b954b23){key=key-to-change0, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:57,711 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:57,712 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,714 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:58:57,715 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:57,715 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:57,715 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90892 to Test-NodeA-7051 09:58:57,715 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #142, conn_id=0) 09:58:57,715 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90892, rsp_expected=true, UNICAST3: DATA, seqno=142, TP: [cluster_name=ISPN] 09:58:57,719 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37717 09:58:57,721 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,721 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:58:57,728 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90892, rsp_expected=true, UNICAST3: DATA, seqno=142, TP: [cluster_name=ISPN] 09:58:57,731 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #141) 09:58:57,731 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=141, ts=88, TP: [cluster_name=ISPN] 09:58:57,731 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #241) 09:58:57,731 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=241, ts=89, TP: [cluster_name=ISPN] 09:58:57,731 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,730 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #142, conn_id=0) 09:58:57,731 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#142 09:58:57,731 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:57,732 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:57,732 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:58:57,733 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=141, ts=88, TP: [cluster_name=ISPN] 09:58:57,733 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #141, conn-id=0, ts=88) 09:58:57,733 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(c2c647d){key=key-to-change0, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:57,733 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:58:57,732 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,733 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:57,733 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,736 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:58:57,736 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=241, ts=89, TP: [cluster_name=ISPN] 09:58:57,738 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change0, value=null, oldValue=initial-value, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:57,738 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:57,738 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #241, conn-id=0, ts=89) 09:58:57,738 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:37717 09:58:57,742 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37717. 09:58:57,742 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37717}. ACQUIRED => RELEASED 09:58:57,742 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37717}? true 09:58:57,742 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37717} 09:58:57,742 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37717}, null) => true 09:58:57,742 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:57,742 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_close_iter_released * 999999999 (available = 999999999, total = 999999999) 09:58:57,742 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_close_iter_released * 1 (available = 999999998, total = 999999999) 09:58:57,742 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 9f3cc66b-64a5-4486-973c-646b1e7b4424 initial state for cache completed 09:58:57,743 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:58:57,744 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:58:57,745 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:58:57,747 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@4c83aab6[Not completed] to self 09:58:57,749 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@2533388d[Not completed] to remote execution at node Test-NodeB-10318 09:58:57,749 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ed5d896] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,751 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ed5d896], mode=SYNCHRONOUS, timeout=15000 09:58:57,751 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ed5d896] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:57,751 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90906] on Test-NodeB-10318 09:58:57,751 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #141, conn_id=1) 09:58:57,771 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #238) 09:58:57,771 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=238, conn_id=2, ts=78, TP: [cluster_name=ISPN] 09:58:57,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,771 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:57,757 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90906, rsp_expected=true, UNICAST3: DATA, seqno=141, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,776 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,772 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=238, conn_id=2, ts=78, TP: [cluster_name=ISPN] 09:58:57,776 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #238, conn-id=2, ts=78) 09:58:57,769 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #140) 09:58:57,776 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=140, conn_id=1, ts=76, TP: [cluster_name=ISPN] 09:58:57,776 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,776 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:57,776 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=140, conn_id=1, ts=76, TP: [cluster_name=ISPN] 09:58:57,778 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #140, conn-id=1, ts=76) 09:58:57,776 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:57,776 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@16c0b2b9[Not completed] to remote execution at node Test-NodeC-52778 09:58:57,779 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ed5d896] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,779 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ed5d896], mode=SYNCHRONOUS, timeout=15000 09:58:57,779 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90906, rsp_expected=true, UNICAST3: DATA, seqno=141, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,780 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ed5d896] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:57,781 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90910] on Test-NodeC-52778 09:58:57,793 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #239, conn_id=2) 09:58:57,793 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90910, rsp_expected=true, UNICAST3: DATA, seqno=239, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,781 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #141, conn_id=1) 09:58:57,793 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,793 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (215 bytes) 09:58:57,793 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#141 09:58:57,799 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90910, rsp_expected=true, UNICAST3: DATA, seqno=239, conn_id=2, TP: [cluster_name=ISPN] 09:58:57,799 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #239, conn_id=2) 09:58:57,799 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#239 09:58:57,799 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90910 09:58:57,799 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28d452bf] [sender=Test-NodeA-7051] 09:58:57,799 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:57,799 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28d452bf] 09:58:57,800 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 9f3cc66b-64a5-4486-973c-646b1e7b4424 09:58:57,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28d452bf] 09:58:57,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90910 to Test-NodeA-7051 09:58:57,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #242, conn_id=0) 09:58:57,801 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90910, rsp_expected=true, UNICAST3: DATA, seqno=242, TP: [cluster_name=ISPN] 09:58:57,801 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,801 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,801 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90910, rsp_expected=true, UNICAST3: DATA, seqno=242, TP: [cluster_name=ISPN] 09:58:57,801 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #242, conn_id=0) 09:58:57,801 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#242 09:58:57,801 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,801 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ed5d896] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:57,798 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90906 09:58:57,810 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4a71dc76] [sender=Test-NodeA-7051] 09:58:57,810 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:57,812 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,812 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4a71dc76] 09:58:57,812 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 9f3cc66b-64a5-4486-973c-646b1e7b4424 09:58:57,817 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4a71dc76] 09:58:57,827 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90906 to Test-NodeA-7051 09:58:57,828 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #143, conn_id=0) 09:58:57,828 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90906, rsp_expected=true, UNICAST3: DATA, seqno=143, TP: [cluster_name=ISPN] 09:58:57,831 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:57,831 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:57,831 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90906, rsp_expected=true, UNICAST3: DATA, seqno=143, TP: [cluster_name=ISPN] 09:58:57,832 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #143, conn_id=0) 09:58:57,832 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#143 09:58:57,832 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,835 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@4ed5d896] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:57,835 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndCompletedSegmentValueOwnerClustered 09:58:57,841 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:57,842 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:57,842 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:57,852 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:57,853 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:57,859 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:57,860 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:58:57,869 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:57,874 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:57,874 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:57,874 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:57,874 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:58:57,874 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:58:57,874 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:58:57,877 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered 09:58:57,877 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6c7284a7] 09:58:57,878 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:57,880 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:58:57,889 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:57,891 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:58:57,898 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,898 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,898 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:57,898 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,901 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,901 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:57,901 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90932] on Test-NodeB-10318 09:58:57,901 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #142, conn_id=1) 09:58:57,901 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90932, rsp_expected=true, UNICAST3: DATA, seqno=142, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,902 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,902 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:57,904 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90932, rsp_expected=true, UNICAST3: DATA, seqno=142, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,904 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #142, conn_id=1) 09:58:57,904 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#142 09:58:57,904 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90932 09:58:57,904 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:57,904 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,904 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37734. timeout=10000 (MILLISECONDS) 09:58:57,904 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37734. Timeout=10000 (MILLISECONDS) 09:58:57,905 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37734} 09:58:57,905 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37734}. Current=null 09:58:57,905 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37734}) => true 09:58:57,905 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37734}. WAITING => ACQUIRED 09:58:57,905 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37734} successfully acquired the lock. 09:58:57,905 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,905 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,909 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,910 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@246a861f] 09:58:57,910 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,910 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:58:57,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37734. timeout=10000 (MILLISECONDS) 09:58:57,919 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37734. Timeout=10000 (MILLISECONDS) 09:58:57,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37734} 09:58:57,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:57,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:57,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:57,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5df82aea){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,921 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,933 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:57,933 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:57,939 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:57,939 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=90936] on Test-NodeC-52778 09:58:57,940 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #59, conn_id=1) 09:58:57,940 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90936, rsp_expected=true, UNICAST3: DATA, seqno=59, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,940 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:57,940 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:57,940 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90936, rsp_expected=true, UNICAST3: DATA, seqno=59, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,940 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #59, conn_id=1) 09:58:57,940 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#59 09:58:57,940 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90936 09:58:57,940 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:57,940 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:57,940 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:57,940 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,940 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:57,940 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2dc801b4] 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(281d502b){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(281d502b){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90936 to Test-NodeB-10318 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #59, conn_id=1) 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90936, rsp_expected=true, UNICAST3: DATA, seqno=59, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,942 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37734 09:58:57,942 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:57,942 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:57,942 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90936, rsp_expected=true, UNICAST3: DATA, seqno=59, conn_id=1, TP: [cluster_name=ISPN] 09:58:57,944 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #59, conn_id=1) 09:58:57,944 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#59 09:58:57,944 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:57,944 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:57,946 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5df82aea){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:57,950 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:58:57,957 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:57,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:57,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:58:57,966 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:58:57,966 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:57,966 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37734 09:58:57,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37734. 09:58:57,988 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37734}. ACQUIRED => RELEASED 09:58:57,988 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37734}? true 09:58:57,988 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37734} 09:58:57,988 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37734}, null) => true 09:58:57,988 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:57,988 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:57,988 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90932 to Test-NodeA-7051 09:58:57,988 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #144, conn_id=0) 09:58:58,001 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90932, rsp_expected=true, UNICAST3: DATA, seqno=144, TP: [cluster_name=ISPN] 09:58:58,009 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37734 09:58:58,009 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,009 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,011 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90932, rsp_expected=true, UNICAST3: DATA, seqno=144, TP: [cluster_name=ISPN] 09:58:58,013 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #144, conn_id=0) 09:58:58,013 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#144 09:58:58,013 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,014 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:58,014 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,016 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@65eabc93] 09:58:58,016 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,016 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:58,016 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:58,016 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:58:58,027 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,027 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,031 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:58,036 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,037 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,037 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,038 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90950] on Test-NodeC-52778 09:58:58,040 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #240, conn_id=2) 09:58:58,041 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90950, rsp_expected=true, UNICAST3: DATA, seqno=240, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,041 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,041 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:58,041 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90950, rsp_expected=true, UNICAST3: DATA, seqno=240, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,042 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #240, conn_id=2) 09:58:58,042 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#240 09:58:58,043 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90950 09:58:58,043 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,043 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,055 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37744. timeout=10000 (MILLISECONDS) 09:58:58,060 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37744. Timeout=10000 (MILLISECONDS) 09:58:58,076 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37744} 09:58:58,076 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37744}. Current=null 09:58:58,076 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37744}) => true 09:58:58,076 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37744}. WAITING => ACQUIRED 09:58:58,076 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37744} successfully acquired the lock. 09:58:58,076 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5f1ff578] 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37744. timeout=10000 (MILLISECONDS) 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37744. Timeout=10000 (MILLISECONDS) 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37744} 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:58,076 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(a9a12eb){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,077 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,077 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,077 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,077 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,081 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:58,082 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90959] on Test-NodeA-7051 09:58:58,082 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #243, conn_id=0) 09:58:58,082 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90959, rsp_expected=true, UNICAST3: DATA, seqno=243, TP: [cluster_name=ISPN] 09:58:58,082 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,082 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:58,082 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90959, rsp_expected=true, UNICAST3: DATA, seqno=243, TP: [cluster_name=ISPN] 09:58:58,085 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #243, conn_id=0) 09:58:58,085 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#243 09:58:58,085 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90959 09:58:58,094 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:58,097 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,097 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,097 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,100 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,100 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@67e6aacd] 09:58:58,102 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,113 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:58:58,114 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,114 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:58:58,116 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,116 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,116 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:58:58,120 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4c8894a9){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,121 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,121 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,121 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4c8894a9){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,122 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:58,122 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,122 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,123 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:58,123 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:58,123 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,123 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 90959 to Test-NodeC-52778 09:58:58,124 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #241, conn_id=2) 09:58:58,128 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90959, rsp_expected=true, UNICAST3: DATA, seqno=241, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,129 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,129 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37744 09:58:58,129 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:58,131 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90959, rsp_expected=true, UNICAST3: DATA, seqno=241, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,131 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #241, conn_id=2) 09:58:58,131 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#241 09:58:58,133 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,133 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:58,258 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(a9a12eb){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,258 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:58:58,258 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,258 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,258 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:58:58,258 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:58:58,258 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,249 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #144) 09:58:58,262 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=144, ts=90, TP: [cluster_name=ISPN] 09:58:58,271 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #243) 09:58:58,271 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=243, ts=91, TP: [cluster_name=ISPN] 09:58:58,271 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #59) 09:58:58,271 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=59, conn_id=1, ts=79, TP: [cluster_name=ISPN] 09:58:58,271 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #241) 09:58:58,271 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:58,271 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:58,272 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=59, conn_id=1, ts=79, TP: [cluster_name=ISPN] 09:58:58,272 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #59, conn-id=1, ts=79) 09:58:58,262 TRACE (Timer-3,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:58,272 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:58,272 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,273 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:58:58,273 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:58,273 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:58,273 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:58,275 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=144, ts=90, TP: [cluster_name=ISPN] 09:58:58,258 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37744 09:58:58,275 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #144, conn-id=0, ts=90) 09:58:58,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37744. 09:58:58,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37744}. ACQUIRED => RELEASED 09:58:58,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37744}? true 09:58:58,273 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=243, ts=91, TP: [cluster_name=ISPN] 09:58:58,273 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:58:58,271 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=241, conn_id=2, ts=80, TP: [cluster_name=ISPN] 09:58:58,277 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeC-52778: mine: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:58:58,277 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,277 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:58,279 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #142) 09:58:58,287 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=241, conn_id=2, ts=80, TP: [cluster_name=ISPN] 09:58:58,279 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=142, conn_id=1, ts=77, TP: [cluster_name=ISPN] 09:58:58,288 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #59) 09:58:58,288 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=59, conn_id=1, ts=78, TP: [cluster_name=ISPN] 09:58:58,288 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:58,288 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:58,289 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:58,291 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=59, conn_id=1, ts=78, TP: [cluster_name=ISPN] 09:58:58,291 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #59, conn-id=1, ts=78) 09:58:58,277 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #243, conn-id=0, ts=91) 09:58:58,292 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=142, conn_id=1, ts=77, TP: [cluster_name=ISPN] 09:58:58,292 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #142, conn-id=1, ts=77) 09:58:58,276 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37744} 09:58:58,293 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37744}, null) => true 09:58:58,293 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,293 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,293 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90950 to Test-NodeA-7051 09:58:58,293 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #244, conn_id=0) 09:58:58,293 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90950, rsp_expected=true, UNICAST3: DATA, seqno=244, TP: [cluster_name=ISPN] 09:58:58,293 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37744 09:58:58,293 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,293 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,293 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90950, rsp_expected=true, UNICAST3: DATA, seqno=244, TP: [cluster_name=ISPN] 09:58:58,293 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #244, conn_id=0) 09:58:58,293 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#244 09:58:58,293 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,293 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,296 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,296 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3e9928a9] 09:58:58,296 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,296 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:58:58,296 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:58,296 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:58:58,297 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,297 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,297 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:58,297 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,297 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,297 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,297 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90980] on Test-NodeC-52778 09:58:58,297 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #242, conn_id=2) 09:58:58,297 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90980, rsp_expected=true, UNICAST3: DATA, seqno=242, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,297 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,297 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:58,297 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90980, rsp_expected=true, UNICAST3: DATA, seqno=242, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,287 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #241, conn-id=2, ts=80) 09:58:58,297 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #242, conn_id=2) 09:58:58,311 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#242 09:58:58,311 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90980 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37762. timeout=10000 (MILLISECONDS) 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37762. Timeout=10000 (MILLISECONDS) 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37762} 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37762}. Current=null 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37762}) => true 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37762}. WAITING => ACQUIRED 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37762} successfully acquired the lock. 09:58:58,318 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,318 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,318 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,318 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@69810bfc] 09:58:58,318 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37762. timeout=10000 (MILLISECONDS) 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37762. Timeout=10000 (MILLISECONDS) 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37762} 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2feb807e){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,319 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:58,320 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90982] on Test-NodeB-10318 09:58:58,328 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #60, conn_id=1) 09:58:58,328 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90982, rsp_expected=true, UNICAST3: DATA, seqno=60, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,328 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:58,328 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:58,330 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90982, rsp_expected=true, UNICAST3: DATA, seqno=60, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,330 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #60, conn_id=1) 09:58:58,330 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#60 09:58:58,330 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90982 09:58:58,330 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:58,330 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,330 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,330 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,330 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,331 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@249cb7c9] 09:58:58,331 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,331 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:58:58,331 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,332 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:58:58,332 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,332 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,332 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:58:58,332 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6510af61){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,334 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,334 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,335 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6510af61){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,335 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90982 to Test-NodeC-52778 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #60, conn_id=1) 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90982, rsp_expected=true, UNICAST3: DATA, seqno=60, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,339 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37762 09:58:58,339 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,341 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:58,343 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90982, rsp_expected=true, UNICAST3: DATA, seqno=60, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,346 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #60, conn_id=1) 09:58:58,346 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#60 09:58:58,347 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,348 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:58,350 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2feb807e){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:58:58,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:58:58,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:58:58,358 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,359 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37762 09:58:58,359 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37762. 09:58:58,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37762}. ACQUIRED => RELEASED 09:58:58,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37762}? true 09:58:58,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37762} 09:58:58,372 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37762}, null) => true 09:58:58,373 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,373 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,373 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90980 to Test-NodeA-7051 09:58:58,373 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #245, conn_id=0) 09:58:58,373 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90980, rsp_expected=true, UNICAST3: DATA, seqno=245, TP: [cluster_name=ISPN] 09:58:58,373 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37762 09:58:58,373 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,373 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,373 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90980, rsp_expected=true, UNICAST3: DATA, seqno=245, TP: [cluster_name=ISPN] 09:58:58,373 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #245, conn_id=0) 09:58:58,373 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#245 09:58:58,373 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,373 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,378 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,378 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1f1f3be7] 09:58:58,378 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,378 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:58:58,378 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:58,378 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:58:58,378 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,378 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,378 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:58,378 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,378 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,378 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,378 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90989] on Test-NodeC-52778 09:58:58,378 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #243, conn_id=2) 09:58:58,378 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90989, rsp_expected=true, UNICAST3: DATA, seqno=243, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,380 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,380 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:58,380 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90989, rsp_expected=true, UNICAST3: DATA, seqno=243, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,380 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #243, conn_id=2) 09:58:58,394 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#243 09:58:58,396 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90989 09:58:58,396 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,397 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,397 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37767. timeout=10000 (MILLISECONDS) 09:58:58,397 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37767. Timeout=10000 (MILLISECONDS) 09:58:58,401 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37767} 09:58:58,401 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37767}. Current=null 09:58:58,401 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37767}) => true 09:58:58,401 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37767}. WAITING => ACQUIRED 09:58:58,401 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37767} successfully acquired the lock. 09:58:58,401 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@598c937e] 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37767. timeout=10000 (MILLISECONDS) 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37767. Timeout=10000 (MILLISECONDS) 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37767} 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(76671729){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,401 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,416 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:58,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=90994] on Test-NodeB-10318 09:58:58,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #61, conn_id=1) 09:58:58,417 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90994, rsp_expected=true, UNICAST3: DATA, seqno=61, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,417 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:58,417 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:58,418 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90994, rsp_expected=true, UNICAST3: DATA, seqno=61, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,418 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #61, conn_id=1) 09:58:58,418 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#61 09:58:58,418 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90994 09:58:58,419 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:58,424 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,425 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,425 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,427 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,427 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@26f4ce5b] 09:58:58,427 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,428 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:58:58,428 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,428 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:58:58,446 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,446 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,446 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(9b92bfb){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(9b92bfb){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 90994 to Test-NodeC-52778 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #61, conn_id=1) 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90994, rsp_expected=true, UNICAST3: DATA, seqno=61, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37767 09:58:58,447 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,447 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:58,449 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90994, rsp_expected=true, UNICAST3: DATA, seqno=61, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,449 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #61, conn_id=1) 09:58:58,449 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#61 09:58:58,449 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,450 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:58,450 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(76671729){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37767 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37767. 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37767}. ACQUIRED => RELEASED 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37767}? true 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37767} 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37767}, null) => true 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,458 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90989 to Test-NodeA-7051 09:58:58,459 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #246, conn_id=0) 09:58:58,459 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90989, rsp_expected=true, UNICAST3: DATA, seqno=246, TP: [cluster_name=ISPN] 09:58:58,459 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37767 09:58:58,459 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,459 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,459 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90989, rsp_expected=true, UNICAST3: DATA, seqno=246, TP: [cluster_name=ISPN] 09:58:58,459 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #246, conn_id=0) 09:58:58,459 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#246 09:58:58,459 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,459 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,459 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,460 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7a1d447c] 09:58:58,460 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,460 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:58,460 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:58,460 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:58:58,460 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,460 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,460 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:58,460 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,460 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,460 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,460 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=90998] on Test-NodeC-52778 09:58:58,460 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #244, conn_id=2) 09:58:58,460 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90998, rsp_expected=true, UNICAST3: DATA, seqno=244, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,460 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,460 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:58,464 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=90998, rsp_expected=true, UNICAST3: DATA, seqno=244, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,464 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #244, conn_id=2) 09:58:58,464 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#244 09:58:58,464 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 90998 09:58:58,464 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,464 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,465 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37780. timeout=10000 (MILLISECONDS) 09:58:58,465 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37780. Timeout=10000 (MILLISECONDS) 09:58:58,465 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37780} 09:58:58,465 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37780}. Current=null 09:58:58,465 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37780}) => true 09:58:58,465 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37780}. WAITING => ACQUIRED 09:58:58,465 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37780} successfully acquired the lock. 09:58:58,465 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@476c5237] 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37780. timeout=10000 (MILLISECONDS) 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37780. Timeout=10000 (MILLISECONDS) 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37780} 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7c3ca12d){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,465 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:58,470 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91000] on Test-NodeA-7051 09:58:58,470 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #247, conn_id=0) 09:58:58,470 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91000, rsp_expected=true, UNICAST3: DATA, seqno=247, TP: [cluster_name=ISPN] 09:58:58,471 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,471 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:58,471 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91000, rsp_expected=true, UNICAST3: DATA, seqno=247, TP: [cluster_name=ISPN] 09:58:58,471 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #247, conn_id=0) 09:58:58,471 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#247 09:58:58,471 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91000 09:58:58,471 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:58,471 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,471 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@31dc7614] 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(66133be1){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(66133be1){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,471 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,472 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91000 to Test-NodeC-52778 09:58:58,472 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #245, conn_id=2) 09:58:58,472 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91000, rsp_expected=true, UNICAST3: DATA, seqno=245, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,472 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37780 09:58:58,472 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,472 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:58,472 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91000, rsp_expected=true, UNICAST3: DATA, seqno=245, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,472 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #245, conn_id=2) 09:58:58,472 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#245 09:58:58,472 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,472 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7c3ca12d){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37780 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37780. 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37780}. ACQUIRED => RELEASED 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37780}? true 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37780} 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37780}, null) => true 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 90998 to Test-NodeA-7051 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #248, conn_id=0) 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90998, rsp_expected=true, UNICAST3: DATA, seqno=248, TP: [cluster_name=ISPN] 09:58:58,472 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37780 09:58:58,472 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,472 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,473 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=90998, rsp_expected=true, UNICAST3: DATA, seqno=248, TP: [cluster_name=ISPN] 09:58:58,473 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #248, conn_id=0) 09:58:58,473 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#248 09:58:58,473 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,473 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,473 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,473 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2b8172cc] 09:58:58,473 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,473 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:58:58,473 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:37781. timeout=10000 (MILLISECONDS) 09:58:58,473 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37781. Timeout=10000 (MILLISECONDS) 09:58:58,473 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37781} 09:58:58,473 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37781}. Current=null 09:58:58,473 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37781}) => true 09:58:58,473 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37781}. WAITING => ACQUIRED 09:58:58,473 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37781} successfully acquired the lock. 09:58:58,473 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:58:58,473 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:58,473 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,473 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,473 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:58,473 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3fd886d3){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,473 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,473 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,473 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:58:58,473 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,473 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,473 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:58,473 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91001] on Test-NodeB-10318 09:58:58,473 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #143, conn_id=1) 09:58:58,473 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91001, rsp_expected=true, UNICAST3: DATA, seqno=143, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,473 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:58,474 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:58,474 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91001, rsp_expected=true, UNICAST3: DATA, seqno=143, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,474 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #143, conn_id=1) 09:58:58,474 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#143 09:58:58,474 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91001 09:58:58,474 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,474 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,474 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@48daf7fa] 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(28513227){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(28513227){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91001 to Test-NodeA-7051 09:58:58,474 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #145, conn_id=0) 09:58:58,481 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91001, rsp_expected=true, UNICAST3: DATA, seqno=145, TP: [cluster_name=ISPN] 09:58:58,481 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37781 09:58:58,482 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,482 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,482 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91001, rsp_expected=true, UNICAST3: DATA, seqno=145, TP: [cluster_name=ISPN] 09:58:58,486 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #145, conn_id=0) 09:58:58,486 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#145 09:58:58,486 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,486 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:58,486 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3fd886d3){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,486 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:58:58,486 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,486 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,486 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:58:58,486 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:58:58,486 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,486 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:37781 09:58:58,486 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37781. 09:58:58,486 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37781}. ACQUIRED => RELEASED 09:58:58,486 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37781}? true 09:58:58,486 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37781} 09:58:58,486 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37781}, null) => true 09:58:58,486 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,486 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5c1247a1] 09:58:58,486 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,486 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:58,486 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:58,486 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:58:58,486 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,486 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,486 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:58,486 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,486 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,486 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,487 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91002] on Test-NodeC-52778 09:58:58,487 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #246, conn_id=2) 09:58:58,487 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91002, rsp_expected=true, UNICAST3: DATA, seqno=246, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,487 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,487 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91002, rsp_expected=true, UNICAST3: DATA, seqno=246, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #246, conn_id=2) 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#246 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91002 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37783. timeout=10000 (MILLISECONDS) 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37783. Timeout=10000 (MILLISECONDS) 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37783} 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37783}. Current=null 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37783}) => true 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37783}. WAITING => ACQUIRED 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37783} successfully acquired the lock. 09:58:58,487 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@188cd159] 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37783. timeout=10000 (MILLISECONDS) 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37783. Timeout=10000 (MILLISECONDS) 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37783} 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(dd10407){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,487 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:58,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91003] on Test-NodeA-7051 09:58:58,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #249, conn_id=0) 09:58:58,488 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91003, rsp_expected=true, UNICAST3: DATA, seqno=249, TP: [cluster_name=ISPN] 09:58:58,488 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,488 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:58,488 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91003, rsp_expected=true, UNICAST3: DATA, seqno=249, TP: [cluster_name=ISPN] 09:58:58,488 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #249, conn_id=0) 09:58:58,488 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#249 09:58:58,488 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91003 09:58:58,488 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:58,488 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,488 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3471452c] 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3c54a2d7){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3c54a2d7){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,488 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:58,489 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:58,489 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,489 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,489 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91003 to Test-NodeC-52778 09:58:58,489 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #247, conn_id=2) 09:58:58,489 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91003, rsp_expected=true, UNICAST3: DATA, seqno=247, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,489 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37783 09:58:58,489 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,489 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:58,489 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91003, rsp_expected=true, UNICAST3: DATA, seqno=247, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,489 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #247, conn_id=2) 09:58:58,489 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#247 09:58:58,489 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,489 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:58,491 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(dd10407){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,491 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:58:58,515 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,515 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,515 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:58:58,515 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37783 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37783. 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37783}. ACQUIRED => RELEASED 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37783}? true 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37783} 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37783}, null) => true 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 91002 to Test-NodeA-7051 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #250, conn_id=0) 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91002, rsp_expected=true, UNICAST3: DATA, seqno=250, TP: [cluster_name=ISPN] 09:58:58,516 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37783 09:58:58,516 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,516 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,516 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91002, rsp_expected=true, UNICAST3: DATA, seqno=250, TP: [cluster_name=ISPN] 09:58:58,516 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #250, conn_id=0) 09:58:58,516 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#250 09:58:58,516 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,517 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,517 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,517 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@734dcc82] 09:58:58,517 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,517 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:58,517 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:58,517 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:58:58,517 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,517 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,517 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:58,517 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,517 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,517 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,517 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91006] on Test-NodeC-52778 09:58:58,517 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #248, conn_id=2) 09:58:58,517 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91006, rsp_expected=true, UNICAST3: DATA, seqno=248, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,517 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,517 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:58,517 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91006, rsp_expected=true, UNICAST3: DATA, seqno=248, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,517 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #248, conn_id=2) 09:58:58,517 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#248 09:58:58,517 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91006 09:58:58,517 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,517 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,517 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37790. timeout=10000 (MILLISECONDS) 09:58:58,518 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37790. Timeout=10000 (MILLISECONDS) 09:58:58,518 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37790} 09:58:58,518 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37790}. Current=null 09:58:58,518 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37790}) => true 09:58:58,518 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37790}. WAITING => ACQUIRED 09:58:58,518 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37790} successfully acquired the lock. 09:58:58,518 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,518 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3e638282] 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37790. timeout=10000 (MILLISECONDS) 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37790. Timeout=10000 (MILLISECONDS) 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37790} 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,545 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5c31a54c){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91007] on Test-NodeA-7051 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #251, conn_id=0) 09:58:58,546 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91007, rsp_expected=true, UNICAST3: DATA, seqno=251, TP: [cluster_name=ISPN] 09:58:58,546 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,546 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:58,546 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91007, rsp_expected=true, UNICAST3: DATA, seqno=251, TP: [cluster_name=ISPN] 09:58:58,546 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #251, conn_id=0) 09:58:58,546 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#251 09:58:58,546 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91007 09:58:58,546 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:58,546 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,546 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,546 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,560 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,561 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6e6a0f9f] 09:58:58,561 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,568 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:58:58,568 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,568 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:58:58,568 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,568 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,574 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:58:58,574 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1159ed80){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,574 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,598 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,600 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1159ed80){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,620 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:58,620 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,620 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,620 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:58,620 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:58,620 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,620 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91007 to Test-NodeC-52778 09:58:58,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #249, conn_id=2) 09:58:58,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91007, rsp_expected=true, UNICAST3: DATA, seqno=249, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,633 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37790 09:58:58,635 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,635 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:58,635 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91007, rsp_expected=true, UNICAST3: DATA, seqno=249, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,636 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #249, conn_id=2) 09:58:58,636 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#249 09:58:58,636 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,636 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5c31a54c){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37790 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37790. 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37790}. ACQUIRED => RELEASED 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37790}? true 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37790} 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37790}, null) => true 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 91006 to Test-NodeA-7051 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #252, conn_id=0) 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91006, rsp_expected=true, UNICAST3: DATA, seqno=252, TP: [cluster_name=ISPN] 09:58:58,636 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37790 09:58:58,636 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,636 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,636 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91006, rsp_expected=true, UNICAST3: DATA, seqno=252, TP: [cluster_name=ISPN] 09:58:58,636 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #252, conn_id=0) 09:58:58,636 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#252 09:58:58,636 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,636 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,637 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,637 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@12242ad8] 09:58:58,637 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,637 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:58:58,637 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:58:58,637 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:58:58,637 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,637 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,637 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:58:58,637 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,637 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,637 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:58,637 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91018] on Test-NodeB-10318 09:58:58,637 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #144, conn_id=1) 09:58:58,637 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91018, rsp_expected=true, UNICAST3: DATA, seqno=144, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,640 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:58,653 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:58:58,658 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91018, rsp_expected=true, UNICAST3: DATA, seqno=144, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,658 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #144, conn_id=1) 09:58:58,676 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#144 09:58:58,684 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91018 09:58:58,684 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,684 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,684 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37796. timeout=10000 (MILLISECONDS) 09:58:58,684 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37796. Timeout=10000 (MILLISECONDS) 09:58:58,684 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37796} 09:58:58,684 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37796}. Current=null 09:58:58,685 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37796}) => true 09:58:58,685 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37796}. WAITING => ACQUIRED 09:58:58,685 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37796} successfully acquired the lock. 09:58:58,685 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2857b760] 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37796. timeout=10000 (MILLISECONDS) 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37796. Timeout=10000 (MILLISECONDS) 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37796} 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6871a762){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91021] on Test-NodeC-52778 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #62, conn_id=1) 09:58:58,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91021, rsp_expected=true, UNICAST3: DATA, seqno=62, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,685 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,685 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:58,685 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91021, rsp_expected=true, UNICAST3: DATA, seqno=62, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,686 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #62, conn_id=1) 09:58:58,686 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#62 09:58:58,686 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91021 09:58:58,686 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:58:58,686 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,686 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@33f762a4] 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6d679191){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6d679191){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 91021 to Test-NodeB-10318 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #62, conn_id=1) 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91021, rsp_expected=true, UNICAST3: DATA, seqno=62, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,686 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37796 09:58:58,686 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:58,686 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:58:58,689 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91021, rsp_expected=true, UNICAST3: DATA, seqno=62, conn_id=1, TP: [cluster_name=ISPN] 09:58:58,689 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #62, conn_id=1) 09:58:58,689 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#62 09:58:58,689 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,689 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,711 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6871a762){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37796 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37796. 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37796}. ACQUIRED => RELEASED 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37796}? true 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37796} 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37796}, null) => true 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91018 to Test-NodeA-7051 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #146, conn_id=0) 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91018, rsp_expected=true, UNICAST3: DATA, seqno=146, TP: [cluster_name=ISPN] 09:58:58,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37796 09:58:58,723 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,723 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,726 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91018, rsp_expected=true, UNICAST3: DATA, seqno=146, TP: [cluster_name=ISPN] 09:58:58,726 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #146, conn_id=0) 09:58:58,726 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#146 09:58:58,726 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,772 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #146) 09:58:58,772 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=146, ts=92, TP: [cluster_name=ISPN] 09:58:58,772 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #252) 09:58:58,772 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=252, ts=93, TP: [cluster_name=ISPN] 09:58:58,774 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:58:58,774 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:58,774 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:58,774 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=252, ts=93, TP: [cluster_name=ISPN] 09:58:58,774 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #252, conn-id=0, ts=93) 09:58:58,774 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=146, ts=92, TP: [cluster_name=ISPN] 09:58:58,774 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #146, conn-id=0, ts=92) 09:58:58,777 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:58,778 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,779 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #62) 09:58:58,778 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5391d87d] 09:58:58,788 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,788 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #144) 09:58:58,788 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=144, conn_id=1, ts=79, TP: [cluster_name=ISPN] 09:58:58,799 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #62) 09:58:58,788 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=62, conn_id=1, ts=81, TP: [cluster_name=ISPN] 09:58:58,799 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=62, conn_id=1, ts=80, TP: [cluster_name=ISPN] 09:58:58,799 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #249) 09:58:58,799 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=249, conn_id=2, ts=82, TP: [cluster_name=ISPN] 09:58:58,799 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:58:58,800 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:58,800 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:58,800 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=249, conn_id=2, ts=82, TP: [cluster_name=ISPN] 09:58:58,800 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #249, conn-id=2, ts=82) 09:58:58,801 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:58:58,801 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:58:58,801 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=62, conn_id=1, ts=81, TP: [cluster_name=ISPN] 09:58:58,801 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:58,801 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #62, conn-id=1, ts=81) 09:58:58,801 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=62, conn_id=1, ts=80, TP: [cluster_name=ISPN] 09:58:58,802 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #62, conn-id=1, ts=80) 09:58:58,802 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=144, conn_id=1, ts=79, TP: [cluster_name=ISPN] 09:58:58,802 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #144, conn-id=1, ts=79) 09:58:58,803 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:58,804 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:58,804 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:58:58,804 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,804 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,804 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:58,804 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,804 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,804 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,804 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91036] on Test-NodeC-52778 09:58:58,804 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #250, conn_id=2) 09:58:58,847 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91036, rsp_expected=true, UNICAST3: DATA, seqno=250, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,848 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,848 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:58:58,848 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91036, rsp_expected=true, UNICAST3: DATA, seqno=250, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,849 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #250, conn_id=2) 09:58:58,849 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#250 09:58:58,878 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91036 09:58:58,878 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,882 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,882 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37811. timeout=10000 (MILLISECONDS) 09:58:58,896 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37811. Timeout=10000 (MILLISECONDS) 09:58:58,903 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37811} 09:58:58,903 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37811}. Current=null 09:58:58,903 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37811}) => true 09:58:58,903 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37811}. WAITING => ACQUIRED 09:58:58,903 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37811} successfully acquired the lock. 09:58:58,903 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@34b9b815] 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:37811. timeout=10000 (MILLISECONDS) 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37811. Timeout=10000 (MILLISECONDS) 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37811} 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(446883fe){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:58,904 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91049] on Test-NodeA-7051 09:58:58,905 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #253, conn_id=0) 09:58:58,905 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91049, rsp_expected=true, UNICAST3: DATA, seqno=253, TP: [cluster_name=ISPN] 09:58:58,905 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,905 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (195 bytes) 09:58:58,905 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91049, rsp_expected=true, UNICAST3: DATA, seqno=253, TP: [cluster_name=ISPN] 09:58:58,905 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #253, conn_id=0) 09:58:58,905 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#253 09:58:58,905 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91049 09:58:58,905 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:58,905 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,905 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2f3f92a2] 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:58:58,905 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3664cf88){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3664cf88){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91049 to Test-NodeC-52778 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #251, conn_id=2) 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91049, rsp_expected=true, UNICAST3: DATA, seqno=251, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,906 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37811 09:58:58,906 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,906 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:58,907 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91049, rsp_expected=true, UNICAST3: DATA, seqno=251, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,907 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #251, conn_id=2) 09:58:58,907 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#251 09:58:58,907 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,907 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(446883fe){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37811 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37811. 09:58:58,909 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37811}. ACQUIRED => RELEASED 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37811}? true 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37811} 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37811}, null) => true 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 91036 to Test-NodeA-7051 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #254, conn_id=0) 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91036, rsp_expected=true, UNICAST3: DATA, seqno=254, TP: [cluster_name=ISPN] 09:58:58,910 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:37811 09:58:58,910 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,910 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:58,910 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91036, rsp_expected=true, UNICAST3: DATA, seqno=254, TP: [cluster_name=ISPN] 09:58:58,910 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #254, conn_id=0) 09:58:58,910 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#254 09:58:58,910 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,910 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,913 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,913 DEBUG (testng-Test:[]) [Test] Found key key-to-change-0 with primary owner != Test-NodeA-7051, segment 60 09:58:58,913 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@66623fef] 09:58:58,913 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:58:58,913 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:58,913 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:58,913 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? false 09:58:58,913 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,913 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,913 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:58,913 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,913 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,913 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:58,913 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91051] on Test-NodeC-52778 09:58:58,913 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #252, conn_id=2) 09:58:58,913 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91051, rsp_expected=true, UNICAST3: DATA, seqno=252, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,927 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (208 bytes (1040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,927 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (211 bytes) 09:58:58,927 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91051, rsp_expected=true, UNICAST3: DATA, seqno=252, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,927 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #252, conn_id=2) 09:58:58,927 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#252 09:58:58,927 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91051 09:58:58,927 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:58:58,927 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,927 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:37821. timeout=10000 (MILLISECONDS) 09:58:58,928 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37821. Timeout=10000 (MILLISECONDS) 09:58:58,928 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37821} 09:58:58,928 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37821}. Current=null 09:58:58,928 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37821}) => true 09:58:58,928 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37821}. WAITING => ACQUIRED 09:58:58,928 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37821} successfully acquired the lock. 09:58:58,928 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@62abf0b6] 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-to-change-0'? true 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:37821. timeout=10000 (MILLISECONDS) 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37821. Timeout=10000 (MILLISECONDS) 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37821} 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4363579e){key=key-to-change-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91054] on Test-NodeA-7051 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #255, conn_id=0) 09:58:58,929 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91054, rsp_expected=true, UNICAST3: DATA, seqno=255, TP: [cluster_name=ISPN] 09:58:58,929 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (208 bytes (1040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,930 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (211 bytes) 09:58:58,930 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91054, rsp_expected=true, UNICAST3: DATA, seqno=255, TP: [cluster_name=ISPN] 09:58:58,930 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #255, conn_id=0) 09:58:58,930 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#255 09:58:58,930 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91054 09:58:58,930 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:58:58,930 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:58,930 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@8cc282c] 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5627e158){key=key-to-change-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5627e158){key=key-to-change-0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-0, value=initial-value} in container 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,946 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91054 to Test-NodeC-52778 09:58:58,964 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #253, conn_id=2) 09:58:58,964 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91054, rsp_expected=true, UNICAST3: DATA, seqno=253, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,964 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37821 09:58:58,964 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:58,964 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:58:58,964 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91054, rsp_expected=true, UNICAST3: DATA, seqno=253, conn_id=2, TP: [cluster_name=ISPN] 09:58:58,964 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #253, conn_id=2) 09:58:58,964 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#253 09:58:58,964 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,964 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:58,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4363579e){key=key-to-change-0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:58:58,964 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:58,971 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-0, value=initial-value} in container 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:37821 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37821. 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37821}. ACQUIRED => RELEASED 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37821}? true 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37821} 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37821}, null) => true 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 91051 to Test-NodeA-7051 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #256, conn_id=0) 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91051, rsp_expected=true, UNICAST3: DATA, seqno=256, TP: [cluster_name=ISPN] 09:58:58,972 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:37821 09:58:58,972 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:58,976 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:58:58,977 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91051, rsp_expected=true, UNICAST3: DATA, seqno=256, TP: [cluster_name=ISPN] 09:58:58,977 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #256, conn_id=0) 09:58:58,981 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#256 09:58:58,997 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:58,997 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:58,997 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:58:58,997 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5232b3fa] 09:58:58,997 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,997 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:58,997 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-0 for read. Entry=ImmortalCacheEntry{key=key-to-change-0, value=initial-value} 09:58:58,997 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:58,997 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:58,997 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-0, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7febf231] 09:58:58,997 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:58:58,997 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:58,997 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-0 for read. Entry=ImmortalCacheEntry{key=key-to-change-0, value=initial-value} 09:58:58,997 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:58:58,997 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:58:58,998 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:58:58,999 TRACE (ForkThread-1,Test:[]) [Test] Started fork runnable.. 09:58:59,014 TRACE (ForkThread-1,Test:[]) [Test] Adding segment listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 : org.infinispan.notifications.cachelistener.DistributedQueueingSegmentListener@68007f8 09:58:59,014 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 09:58:59,015 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@737a5821[Not completed] to remote execution at node Test-NodeB-10318 09:58:58,998 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_complete_segment_invoked * 1 09:58:59,015 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@295f035b] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,027 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@295f035b], mode=SYNCHRONOUS, timeout=15000 09:58:59,051 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@295f035b] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:59,051 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91072] on Test-NodeB-10318 09:58:59,051 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #145, conn_id=1) 09:58:59,051 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91072, rsp_expected=true, UNICAST3: DATA, seqno=145, conn_id=1, TP: [cluster_name=ISPN] 09:58:59,051 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:59,051 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@450f30c4[Not completed] to remote execution at node Test-NodeC-52778 09:58:59,051 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@295f035b] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,051 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@295f035b], mode=SYNCHRONOUS, timeout=15000 09:58:59,051 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@295f035b] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:59,051 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91073] on Test-NodeC-52778 09:58:59,051 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #254, conn_id=2) 09:58:59,051 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91073, rsp_expected=true, UNICAST3: DATA, seqno=254, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,051 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:58:59,062 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,062 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (239 bytes) 09:58:59,062 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91073, rsp_expected=true, UNICAST3: DATA, seqno=254, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,062 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #254, conn_id=2) 09:58:59,062 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#254 09:58:59,062 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91073 09:58:59,063 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@58ec4611] [sender=Test-NodeA-7051] 09:58:59,063 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:59,063 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@58ec4611] 09:58:59,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 09:58:59,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@58ec4611] 09:58:59,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 91073 to Test-NodeA-7051 09:58:59,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #257, conn_id=0) 09:58:59,063 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91073, rsp_expected=true, UNICAST3: DATA, seqno=257, TP: [cluster_name=ISPN] 09:58:59,065 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,065 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:58:59,066 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91073, rsp_expected=true, UNICAST3: DATA, seqno=257, TP: [cluster_name=ISPN] 09:58:59,085 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #257, conn_id=0) 09:58:59,085 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#257 09:58:59,085 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:59,085 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@295f035b] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:59,065 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91072, rsp_expected=true, UNICAST3: DATA, seqno=145, conn_id=1, TP: [cluster_name=ISPN] 09:58:59,097 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #145, conn_id=1) 09:58:59,097 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#145 09:58:59,097 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91072 09:58:59,098 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3ba25f3b] [sender=Test-NodeA-7051] 09:58:59,098 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:59,098 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,098 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3ba25f3b] 09:58:59,098 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 09:58:59,125 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3ba25f3b] 09:58:59,125 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91072 to Test-NodeA-7051 09:58:59,125 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #147, conn_id=0) 09:58:59,125 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91072, rsp_expected=true, UNICAST3: DATA, seqno=147, TP: [cluster_name=ISPN] 09:58:59,125 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,125 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:59,139 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91072, rsp_expected=true, UNICAST3: DATA, seqno=147, TP: [cluster_name=ISPN] 09:58:59,139 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #147, conn_id=0) 09:58:59,139 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#147 09:58:59,139 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:59,139 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@295f035b] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:59,145 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 requests initial state for cache 09:58:59,145 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@813a63f] 09:58:59,145 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:59,146 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:58:59,160 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705114 09:58:59,161 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705114 excluding keys [] 09:58:59,161 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,161 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:59,161 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:59,161 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:59,161 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91087] on Test-NodeB-10318 09:58:59,161 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #146, conn_id=1) 09:58:59,161 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91087, rsp_expected=true, UNICAST3: DATA, seqno=146, conn_id=1, TP: [cluster_name=ISPN] 09:58:59,161 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:59,161 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:58:59,162 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91087, rsp_expected=true, UNICAST3: DATA, seqno=146, conn_id=1, TP: [cluster_name=ISPN] 09:58:59,162 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #146, conn_id=1) 09:58:59,162 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#146 09:58:59,162 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91087 09:58:59,162 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:59,162 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:59,162 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705114 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@9d46e34] 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705114 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705114 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705114 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:59,163 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705114 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:58:59,164 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705114 09:58:59,164 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,164 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:59,164 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:59,164 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91088] on Test-NodeA-7051 09:58:59,164 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #148, conn_id=0) 09:58:59,164 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91088, rsp_expected=true, UNICAST3: DATA, seqno=148, TP: [cluster_name=ISPN] 09:58:59,164 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (225 bytes (1125.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,164 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (228 bytes) 09:58:59,164 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=151 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91088, rsp_expected=true, UNICAST3: DATA, seqno=148, TP: [cluster_name=ISPN] 09:58:59,164 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #148, conn_id=0) 09:58:59,164 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#148 09:58:59,164 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91088 09:58:59,164 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:58:59,168 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:59,184 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,185 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:59,185 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705114 with [] suspected segments. 09:58:59,185 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:58:59,185 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:58:59,185 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 117, 247, 248, 252, 254, 127] 09:58:59,186 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:59,186 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91088 to Test-NodeB-10318 09:58:59,186 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #147, conn_id=1) 09:58:59,186 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91088, rsp_expected=true, UNICAST3: DATA, seqno=147, conn_id=1, TP: [cluster_name=ISPN] 09:58:59,186 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:59,186 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:58:59,187 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91088, rsp_expected=true, UNICAST3: DATA, seqno=147, conn_id=1, TP: [cluster_name=ISPN] 09:58:59,219 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #147, conn_id=1) 09:58:59,219 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#147 09:58:59,219 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:59,219 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:59,246 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,247 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-0 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:58:59,233 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:59,252 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91087 to Test-NodeA-7051 09:58:59,252 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #149, conn_id=0) 09:58:59,252 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91087, rsp_expected=true, UNICAST3: DATA, seqno=149, TP: [cluster_name=ISPN] 09:58:59,262 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,267 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:58:59,247 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:58:59,271 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [244, 251] 09:58:59,271 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,271 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-8 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:58:59,271 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:58:59,272 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91087, rsp_expected=true, UNICAST3: DATA, seqno=149, TP: [cluster_name=ISPN] 09:58:59,273 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #149, conn_id=0) 09:58:59,273 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#149 09:58:59,273 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:58:59,273 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:59,273 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705114 excluding keys [] 09:58:59,273 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,273 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:58:59,273 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:59,273 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:59,273 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91095] on Test-NodeC-52778 09:58:59,273 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #255, conn_id=2) 09:58:59,273 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91095, rsp_expected=true, UNICAST3: DATA, seqno=255, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,273 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (607 bytes (3035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,273 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (610 bytes) 09:58:59,274 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91095, rsp_expected=true, UNICAST3: DATA, seqno=255, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,274 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #255, conn_id=2) 09:58:59,274 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#255 09:58:59,274 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91095 09:58:59,274 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:58:59,274 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:59,274 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,274 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:59,274 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705114 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:59,274 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@65fe3871] 09:58:59,274 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:58:59,274 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705114 09:58:59,274 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705114 09:58:59,274 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705114 09:58:59,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:59,275 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #149) 09:58:59,277 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=149, ts=94, TP: [cluster_name=ISPN] 09:58:59,275 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705114 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:58:59,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705114 09:58:59,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:58:59,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:59,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91097] on Test-NodeA-7051 09:58:59,284 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #258, conn_id=0) 09:58:59,279 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:59,288 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:58:59,288 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=149, ts=94, TP: [cluster_name=ISPN] 09:58:59,288 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #149, conn-id=0, ts=94) 09:58:59,277 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #257) 09:58:59,302 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=257, ts=95, TP: [cluster_name=ISPN] 09:58:59,301 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #255) 09:58:59,303 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=255, conn_id=2, ts=83, TP: [cluster_name=ISPN] 09:58:59,303 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,303 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:59,304 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=255, conn_id=2, ts=83, TP: [cluster_name=ISPN] 09:58:59,304 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #255, conn-id=2, ts=83) 09:58:59,315 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91097, rsp_expected=true, UNICAST3: DATA, seqno=258, TP: [cluster_name=ISPN] 09:58:59,315 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (350 bytes (1750.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,315 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (353 bytes) 09:58:59,315 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=275 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91097, rsp_expected=true, UNICAST3: DATA, seqno=258, TP: [cluster_name=ISPN] 09:58:59,315 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #258, conn_id=0) 09:58:59,315 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#258 09:58:59,315 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91097 09:58:59,315 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:58:59,304 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #147) 09:58:59,303 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,318 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:58:59,318 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=147, conn_id=1, ts=81, TP: [cluster_name=ISPN] 09:58:59,325 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=257, ts=95, TP: [cluster_name=ISPN] 09:58:59,325 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #257, conn-id=0, ts=95) 09:58:59,315 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:59,336 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:59,336 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705114 with [] suspected segments. 09:58:59,322 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,352 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:58:59,348 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:58:59,353 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 8 09:58:59,354 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [129, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 180, 181, 63, 67, 195, 69, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 103, 107, 108, 236, 239, 240, 113, 241, 245, 119, 120, 249, 122, 124, 253] 09:58:59,354 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705114 as completed! 09:58:59,354 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:58:59,354 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91097 to Test-NodeC-52778 09:58:59,354 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #256, conn_id=2) 09:58:59,354 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91097, rsp_expected=true, UNICAST3: DATA, seqno=256, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,354 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,354 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (80 bytes) 09:58:59,354 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91097, rsp_expected=true, UNICAST3: DATA, seqno=256, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,354 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #256, conn_id=2) 09:58:59,354 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#256 09:58:59,354 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:58:59,354 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:59,353 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=147, conn_id=1, ts=81, TP: [cluster_name=ISPN] 09:58:59,364 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #147, conn-id=1, ts=81) 09:58:59,359 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:58:59,371 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,372 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-1 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 129 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 130 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 131 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 4 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 132 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 133 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 135 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 8 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 10 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 139 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 14 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 15 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 16 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 18 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 19 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 147 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 148 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 21 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 151 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 153 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 30 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 158 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 31 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 159 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 164 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 40 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 41 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 45 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 47 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 180 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 181 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 63 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 67 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 195 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 69 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 201 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 74 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 203 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 76 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 205 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 78 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 81 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 82 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 210 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 83 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 85 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 86 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 90 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 219 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 93 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 94 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 222 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 96 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 224 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 98 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 99 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 227 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 228 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 103 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 107 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 108 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 236 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 239 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 240 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 113 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 241 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 245 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 119 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 120 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 249 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 122 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 124 09:58:59,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 253 09:58:59,372 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,372 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-4 09:58:59,372 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,372 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-3 09:58:59,372 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-2 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-9 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-7 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-6 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [48, 2, 229, 118, 71, 72, 233, 60] 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,373 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-to-change-0 09:58:59,373 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_complete_segment_invoked * 1 (available = 1, total = 1) 09:58:59,373 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_complete_segment_released * 1 09:58:59,373 TRACE (testng-Test:[]) [CheckPoint] Received event pre_complete_segment_invoked * 1 (available = 0, total = 1) 09:58:59,373 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@72fb9fe7] 09:58:59,373 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id -1 09:58:59,373 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:59,373 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:58:59,373 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? false 09:58:59,373 TRACE (testng-Test:[]) [CallInterceptor] Invoking: RemoveCommand 09:58:59,373 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:59,373 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:58:59,373 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,373 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:58:59,373 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:59,373 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91103] on Test-NodeC-52778 09:58:59,373 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #257, conn_id=2) 09:58:59,374 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91103, rsp_expected=true, UNICAST3: DATA, seqno=257, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,376 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (174 bytes (870.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,377 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (177 bytes) 09:58:59,377 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=99 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91103, rsp_expected=true, UNICAST3: DATA, seqno=257, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,377 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #257, conn_id=2) 09:58:59,377 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#257 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91103 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeA-7051] 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:37898. timeout=10000 (MILLISECONDS) 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37898. Timeout=10000 (MILLISECONDS) 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37898} 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37898}. Current=null 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37898}) => true 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37898}. WAITING => ACQUIRED 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37898} successfully acquired the lock. 09:58:59,378 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:59,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:58:59,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7a2602c0] 09:58:59,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:58:59,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-to-change-0'? true 09:58:59,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-to-change-0 for owner=CommandInvocation:Test-NodeA-7051:37898. timeout=10000 (MILLISECONDS) 09:58:59,379 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37898. Timeout=10000 (MILLISECONDS) 09:58:59,379 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37898} 09:58:59,371 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [RequestCorrelator] sending rsp for 91095 to Test-NodeA-7051 09:58:59,383 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #259, conn_id=0) 09:58:59,383 TRACE (remote-thread-Test-NodeC-p23887-t6:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91095, rsp_expected=true, UNICAST3: DATA, seqno=259, TP: [cluster_name=ISPN] 09:58:59,384 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,381 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:58:59,385 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:59,385 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:58:59,384 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (80 bytes) 09:58:59,393 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91095, rsp_expected=true, UNICAST3: DATA, seqno=259, TP: [cluster_name=ISPN] 09:58:59,393 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #259, conn_id=0) 09:58:59,393 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#259 09:58:59,393 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:58:59,393 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:59,393 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:59,393 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-705114 09:58:59,393 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:59,393 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:58:59,394 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [Test] Completed segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:58:59,394 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705114 09:58:59,394 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705114 being completed: true 09:58:59,394 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705114 09:58:59,411 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:59,411 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:59,411 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7e19895c){key=key-to-change-0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:59,411 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: RemoveCommand 09:58:59,411 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:59,411 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:58:59,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:59,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91107] on Test-NodeA-7051 09:58:59,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #260, conn_id=0) 09:58:59,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91107, rsp_expected=true, UNICAST3: DATA, seqno=260, TP: [cluster_name=ISPN] 09:58:59,412 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (174 bytes (870.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,443 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (177 bytes) 09:58:59,494 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=99 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91107, rsp_expected=true, UNICAST3: DATA, seqno=260, TP: [cluster_name=ISPN] 09:58:59,511 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #260, conn_id=0) 09:58:59,526 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#260 09:58:59,526 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91107 09:58:59,526 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeC-52778] 09:58:59,526 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:58:59,526 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,526 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:59,527 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:58:59,527 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7c3293de] 09:58:59,527 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-0'? false 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-0'? true 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-0 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(15769021){key=key-to-change-0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: RemoveCommand 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(15769021){key=key-to-change-0, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:59,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91107 to Test-NodeC-52778 09:58:59,578 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #258, conn_id=2) 09:58:59,578 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91107, rsp_expected=true, UNICAST3: DATA, seqno=258, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,578 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37898 09:58:59,578 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (94 bytes (470.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,578 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (97 bytes) 09:58:59,640 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91107, rsp_expected=true, UNICAST3: DATA, seqno=258, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,640 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #258, conn_id=2) 09:58:59,640 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#258 09:58:59,642 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:59,660 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeA-7051=SuccessfulResponse{responseValue=initial-value} } 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7e19895c){key=key-to-change-0, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-to-change-0. Operation Flag=null, L1 invalidation=false 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-to-change-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5b34f7b4[Not completed] to remote execution at node Test-NodeA-7051 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@188ed829] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@188ed829], mode=SYNCHRONOUS, timeout=15000 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@188ed829] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91126] on Test-NodeA-7051 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #261, conn_id=0) 09:58:59,661 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91126, rsp_expected=true, UNICAST3: DATA, seqno=261, TP: [cluster_name=ISPN] 09:58:59,661 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (363 bytes (1815.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,661 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (366 bytes) 09:58:59,661 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=288 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91126, rsp_expected=true, UNICAST3: DATA, seqno=261, TP: [cluster_name=ISPN] 09:58:59,675 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #261, conn_id=0) 09:58:59,684 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#261 09:58:59,684 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91126 09:58:59,685 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@640b0234] [sender=Test-NodeC-52778] 09:58:59,699 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:59,779 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,779 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@640b0234] 09:58:59,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-0, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeC-52778}], notifying cluster listener with id 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 09:58:59,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@640b0234] 09:58:59,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91126 to Test-NodeC-52778 09:58:59,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #259, conn_id=2) 09:58:59,780 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91126, rsp_expected=true, UNICAST3: DATA, seqno=259, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,780 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,780 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:58:59,803 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #261) 09:58:59,803 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=261, ts=96, TP: [cluster_name=ISPN] 09:58:59,803 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,804 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:58:59,804 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=261, ts=96, TP: [cluster_name=ISPN] 09:58:59,804 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #261, conn-id=0, ts=96) 09:58:59,780 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91126, rsp_expected=true, UNICAST3: DATA, seqno=259, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,810 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #259, conn_id=2) 09:58:59,803 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #258) 09:58:59,818 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=258, conn_id=2, ts=84, TP: [cluster_name=ISPN] 09:58:59,818 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,818 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:58:59,818 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=258, conn_id=2, ts=84, TP: [cluster_name=ISPN] 09:58:59,818 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #258, conn-id=2, ts=84) 09:58:59,810 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#259 09:58:59,830 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:59,830 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@188ed829] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:58:59,831 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:37898 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37898. 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37898}. ACQUIRED => RELEASED 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37898}? true 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37898} 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37898}, null) => true 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91103 to Test-NodeA-7051 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #262, conn_id=0) 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91103, rsp_expected=true, UNICAST3: DATA, seqno=262, TP: [cluster_name=ISPN] 09:58:59,836 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-to-change-0]. owner=CommandInvocation:Test-NodeA-7051:37898 09:58:59,836 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (94 bytes (470.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,836 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (97 bytes) 09:58:59,837 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91103, rsp_expected=true, UNICAST3: DATA, seqno=262, TP: [cluster_name=ISPN] 09:58:59,837 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #262, conn_id=0) 09:58:59,837 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#262 09:58:59,837 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:58:59,837 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change-0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeC-52778=SuccessfulResponse{responseValue=initial-value} } 09:58:59,837 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:58:59,837 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_complete_segment_released * 999999999 (available = 999999999, total = 999999999) 09:58:59,837 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_complete_segment_released * 1 (available = 999999998, total = 999999999) 09:58:59,837 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:58:59,837 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:58:59,837 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:58:59,837 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:58:59,837 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:58:59,837 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:58:59,841 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:58:59,842 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:58:59,842 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:58:59,842 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:58:59,842 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:58:59,842 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:58:59,843 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:58:59,875 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:58:59,875 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:58:59,875 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:58:59,875 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:58:59,875 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:58:59,875 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:58:59,879 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:58:59,883 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:58:59,883 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:58:59,883 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:58:59,883 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:58:59,883 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:58:59,883 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:58:59,886 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:58:59,887 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:58:59,889 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [24] 09:58:59,893 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:58:59,893 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-5 09:58:59,893 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:58:59,898 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 initial state for cache completed 09:58:59,899 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork runnable. 09:58:59,900 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@67368ad1[Not completed] to self 09:58:59,906 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@a5bc346[Not completed] to remote execution at node Test-NodeB-10318 09:58:59,906 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7ddf09f0] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,907 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7ddf09f0], mode=SYNCHRONOUS, timeout=15000 09:58:59,907 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7ddf09f0] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:58:59,907 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91144] on Test-NodeB-10318 09:58:59,907 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #148, conn_id=1) 09:58:59,911 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91144, rsp_expected=true, UNICAST3: DATA, seqno=148, conn_id=1, TP: [cluster_name=ISPN] 09:58:59,911 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:58:59,911 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:58:59,914 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91144, rsp_expected=true, UNICAST3: DATA, seqno=148, conn_id=1, TP: [cluster_name=ISPN] 09:58:59,914 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #148, conn_id=1) 09:58:59,914 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#148 09:58:59,914 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91144 09:58:59,914 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@58ae0b07] [sender=Test-NodeA-7051] 09:58:59,914 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:59,914 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,916 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@58ae0b07] 09:58:59,911 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@698125ac[Not completed] to remote execution at node Test-NodeC-52778 09:58:59,918 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7ddf09f0] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:58:59,918 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7ddf09f0], mode=SYNCHRONOUS, timeout=15000 09:58:59,918 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7ddf09f0] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:58:59,918 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91147] on Test-NodeC-52778 09:58:59,918 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #260, conn_id=2) 09:58:59,918 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91147, rsp_expected=true, UNICAST3: DATA, seqno=260, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,916 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 09:58:59,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@58ae0b07] 09:58:59,919 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (213 bytes (1065.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:58:59,921 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (216 bytes) 09:58:59,921 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91147, rsp_expected=true, UNICAST3: DATA, seqno=260, conn_id=2, TP: [cluster_name=ISPN] 09:58:59,921 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #260, conn_id=2) 09:58:59,921 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#260 09:58:59,921 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91147 09:58:59,921 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f2ea005] [sender=Test-NodeA-7051] 09:58:59,921 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:58:59,921 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:58:59,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f2ea005] 09:58:59,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 2a41ec3f-c79f-4b7d-bd0e-8754170d8fc1 09:58:59,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f2ea005] 09:58:59,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91147 to Test-NodeA-7051 09:58:59,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #263, conn_id=0) 09:58:59,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91147, rsp_expected=true, UNICAST3: DATA, seqno=263, TP: [cluster_name=ISPN] 09:58:59,922 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,922 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:58:59,920 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91144 to Test-NodeA-7051 09:58:59,932 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91147, rsp_expected=true, UNICAST3: DATA, seqno=263, TP: [cluster_name=ISPN] 09:58:59,932 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #263, conn_id=0) 09:58:59,932 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#263 09:58:59,932 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:59,932 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7ddf09f0] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:58:59,932 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #150, conn_id=0) 09:58:59,939 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91144, rsp_expected=true, UNICAST3: DATA, seqno=150, TP: [cluster_name=ISPN] 09:58:59,941 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:58:59,941 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:58:59,942 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91144, rsp_expected=true, UNICAST3: DATA, seqno=150, TP: [cluster_name=ISPN] 09:58:59,942 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #150, conn_id=0) 09:58:59,942 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#150 09:58:59,942 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:58:59,942 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7ddf09f0] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:58:59,943 ERROR (testng-Test:[]) [TestSuiteProgress] Test failed: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered java.lang.AssertionError: expected [12] but found [11] at org.testng.Assert.fail(Assert.java:94) ~[testng-6.8.8.jar:?] at org.testng.Assert.failNotEquals(Assert.java:494) ~[testng-6.8.8.jar:?] at org.testng.Assert.assertEquals(Assert.java:123) ~[testng-6.8.8.jar:?] at org.testng.Assert.assertEquals(Assert.java:370) ~[testng-6.8.8.jar:?] at org.testng.Assert.assertEquals(Assert.java:380) ~[testng-6.8.8.jar:?] at org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testIterationBeganAndSegmentNotComplete(CacheNotifierImplInitialTransferDistTest.java:501) ~[test-classes/:?] at org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueNonOwnerClustered(CacheNotifierImplInitialTransferDistTest.java:636) ~[test-classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_101] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_101] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_101] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_101] at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84) ~[testng-6.8.8.jar:?] at org.testng.internal.Invoker.invokeMethod(Invoker.java:714) [testng-6.8.8.jar:?] at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901) [testng-6.8.8.jar:?] at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231) [testng-6.8.8.jar:?] at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127) [testng-6.8.8.jar:?] at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111) [testng-6.8.8.jar:?] at org.testng.TestRunner.privateRun(TestRunner.java:767) [testng-6.8.8.jar:?] at org.testng.TestRunner.run(TestRunner.java:617) [testng-6.8.8.jar:?] at org.testng.SuiteRunner.runTest(SuiteRunner.java:348) [testng-6.8.8.jar:?] at org.testng.SuiteRunner.access$000(SuiteRunner.java:38) [testng-6.8.8.jar:?] at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:382) [testng-6.8.8.jar:?] at org.testng.internal.thread.ThreadUtil$2.call(ThreadUtil.java:64) [testng-6.8.8.jar:?] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_101] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_101] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_101] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101] 09:58:59,944 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:58:59,962 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:58:59,970 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:58:59,971 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:58:59,971 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:59,971 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:58:59,986 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:58:59,990 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:59,999 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:58:59,999 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:58:59,999 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:58:59,999 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:59:00,001 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:59:00,001 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:59:00,001 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueOwnerClustered 09:59:00,001 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3afb8a76] 09:59:00,001 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,001 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:59:00,001 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:00,001 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:59:00,001 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,001 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,001 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:00,001 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,001 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,001 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:00,001 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91158] on Test-NodeB-10318 09:59:00,001 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #149, conn_id=1) 09:59:00,001 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91158, rsp_expected=true, UNICAST3: DATA, seqno=149, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,001 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,001 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91158, rsp_expected=true, UNICAST3: DATA, seqno=149, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #149, conn_id=1) 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#149 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91158 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37921. timeout=10000 (MILLISECONDS) 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37921. Timeout=10000 (MILLISECONDS) 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37921} 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37921}. Current=null 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37921}) => true 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37921}. WAITING => ACQUIRED 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37921} successfully acquired the lock. 09:59:00,002 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@277148b] 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:37921. timeout=10000 (MILLISECONDS) 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37921. Timeout=10000 (MILLISECONDS) 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37921} 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5131be1d){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,002 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:00,003 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91159] on Test-NodeC-52778 09:59:00,003 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #63, conn_id=1) 09:59:00,003 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91159, rsp_expected=true, UNICAST3: DATA, seqno=63, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,003 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,004 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:59:00,004 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91159, rsp_expected=true, UNICAST3: DATA, seqno=63, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,004 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #63, conn_id=1) 09:59:00,004 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#63 09:59:00,004 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91159 09:59:00,004 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:00,004 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,004 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2c7b8ea9] 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(619e34c4){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(619e34c4){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:59:00,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,005 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,005 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91159 to Test-NodeB-10318 09:59:00,005 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #63, conn_id=1) 09:59:00,005 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91159, rsp_expected=true, UNICAST3: DATA, seqno=63, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,005 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37921 09:59:00,005 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,005 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:00,007 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91159, rsp_expected=true, UNICAST3: DATA, seqno=63, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,007 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #63, conn_id=1) 09:59:00,007 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#63 09:59:00,007 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,007 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5131be1d){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37921 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37921. 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37921}. ACQUIRED => RELEASED 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37921}? true 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37921} 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37921}, null) => true 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91158 to Test-NodeA-7051 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #151, conn_id=0) 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91158, rsp_expected=true, UNICAST3: DATA, seqno=151, TP: [cluster_name=ISPN] 09:59:00,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:37921 09:59:00,010 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,014 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:00,017 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91158, rsp_expected=true, UNICAST3: DATA, seqno=151, TP: [cluster_name=ISPN] 09:59:00,017 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #151, conn_id=0) 09:59:00,017 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#151 09:59:00,017 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,017 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:00,030 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,030 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@42c37500] 09:59:00,030 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,030 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:59:00,077 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:00,077 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:59:00,077 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,078 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,084 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:00,084 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,084 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,093 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:00,107 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91170] on Test-NodeC-52778 09:59:00,107 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #261, conn_id=2) 09:59:00,107 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91170, rsp_expected=true, UNICAST3: DATA, seqno=261, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,107 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,108 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91170, rsp_expected=true, UNICAST3: DATA, seqno=261, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #261, conn_id=2) 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#261 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91170 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37923. timeout=10000 (MILLISECONDS) 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37923. Timeout=10000 (MILLISECONDS) 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37923} 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37923}. Current=null 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37923}) => true 09:59:00,108 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37923}. WAITING => ACQUIRED 09:59:00,114 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37923} successfully acquired the lock. 09:59:00,152 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,152 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,152 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@787abdca] 09:59:00,152 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,152 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,154 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:37923. timeout=10000 (MILLISECONDS) 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37923. Timeout=10000 (MILLISECONDS) 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37923} 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(68c9a9d6){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,169 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,170 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:00,170 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91177] on Test-NodeA-7051 09:59:00,170 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #264, conn_id=0) 09:59:00,170 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91177, rsp_expected=true, UNICAST3: DATA, seqno=264, TP: [cluster_name=ISPN] 09:59:00,170 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,170 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:00,170 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91177, rsp_expected=true, UNICAST3: DATA, seqno=264, TP: [cluster_name=ISPN] 09:59:00,170 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #264, conn_id=0) 09:59:00,170 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#264 09:59:00,170 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91177 09:59:00,170 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:00,170 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,170 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,170 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,170 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,170 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@29538b93] 09:59:00,251 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,252 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:59:00,258 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:00,258 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:59:00,258 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:59:00,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(805f100){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,260 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,260 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(805f100){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,263 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:59:00,263 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,264 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,264 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:59:00,265 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:59:00,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,279 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,280 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91177 to Test-NodeC-52778 09:59:00,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #262, conn_id=2) 09:59:00,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91177, rsp_expected=true, UNICAST3: DATA, seqno=262, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,284 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37923 09:59:00,284 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,284 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:00,287 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91177, rsp_expected=true, UNICAST3: DATA, seqno=262, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,296 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #262, conn_id=2) 09:59:00,296 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#262 09:59:00,296 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,296 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(68c9a9d6){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37923 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37923. 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37923}. ACQUIRED => RELEASED 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37923}? true 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37923} 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37923}, null) => true 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91170 to Test-NodeA-7051 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #265, conn_id=0) 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91170, rsp_expected=true, UNICAST3: DATA, seqno=265, TP: [cluster_name=ISPN] 09:59:00,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:37923 09:59:00,297 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,297 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:00,297 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91170, rsp_expected=true, UNICAST3: DATA, seqno=265, TP: [cluster_name=ISPN] 09:59:00,297 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #265, conn_id=0) 09:59:00,297 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#265 09:59:00,297 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,297 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:00,297 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,297 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@e73f98c] 09:59:00,297 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,298 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:59:00,298 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:00,298 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:59:00,298 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,298 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,298 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:00,298 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,298 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,298 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:00,298 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91191] on Test-NodeC-52778 09:59:00,298 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #263, conn_id=2) 09:59:00,298 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91191, rsp_expected=true, UNICAST3: DATA, seqno=263, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,298 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,298 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:00,298 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91191, rsp_expected=true, UNICAST3: DATA, seqno=263, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,298 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #263, conn_id=2) 09:59:00,298 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#263 09:59:00,298 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91191 09:59:00,298 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37943. timeout=10000 (MILLISECONDS) 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37943. Timeout=10000 (MILLISECONDS) 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37943} 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37943}. Current=null 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37943}) => true 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37943}. WAITING => ACQUIRED 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37943} successfully acquired the lock. 09:59:00,299 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5183fc1e] 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:37943. timeout=10000 (MILLISECONDS) 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37943. Timeout=10000 (MILLISECONDS) 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37943} 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(45eba147){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91192] on Test-NodeB-10318 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #64, conn_id=1) 09:59:00,299 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91192, rsp_expected=true, UNICAST3: DATA, seqno=64, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,299 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,299 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:00,299 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91192, rsp_expected=true, UNICAST3: DATA, seqno=64, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,300 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #64, conn_id=1) 09:59:00,300 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#64 09:59:00,300 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91192 09:59:00,300 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:00,300 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,300 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@40dd2edb] 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(380de39c){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(380de39c){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91192 to Test-NodeC-52778 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #64, conn_id=1) 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91192, rsp_expected=true, UNICAST3: DATA, seqno=64, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37943 09:59:00,302 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,302 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:59:00,304 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #151) 09:59:00,304 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91192, rsp_expected=true, UNICAST3: DATA, seqno=64, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,304 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #64, conn_id=1) 09:59:00,318 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #64) 09:59:00,318 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=64, conn_id=1, ts=85, TP: [cluster_name=ISPN] 09:59:00,318 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,318 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:00,318 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=64, conn_id=1, ts=85, TP: [cluster_name=ISPN] 09:59:00,318 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #64, conn-id=1, ts=85) 09:59:00,304 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#64 09:59:00,304 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=151, ts=97, TP: [cluster_name=ISPN] 09:59:00,318 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,318 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #265) 09:59:00,318 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #263) 09:59:00,324 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #149) 09:59:00,324 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=149, conn_id=1, ts=82, TP: [cluster_name=ISPN] 09:59:00,319 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,319 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:00,326 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=265, ts=98, TP: [cluster_name=ISPN] 09:59:00,326 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:00,326 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=263, conn_id=2, ts=86, TP: [cluster_name=ISPN] 09:59:00,324 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,324 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #64) 09:59:00,327 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:00,327 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=149, conn_id=1, ts=82, TP: [cluster_name=ISPN] 09:59:00,327 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #149, conn-id=1, ts=82) 09:59:00,329 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=151, ts=97, TP: [cluster_name=ISPN] 09:59:00,329 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #151, conn-id=0, ts=97) 09:59:00,330 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=64, conn_id=1, ts=83, TP: [cluster_name=ISPN] 09:59:00,330 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,330 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:00,331 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=64, conn_id=1, ts=83, TP: [cluster_name=ISPN] 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(45eba147){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37943 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37943. 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37943}. ACQUIRED => RELEASED 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37943}? true 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37943} 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37943}, null) => true 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91191 to Test-NodeA-7051 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #266, conn_id=0) 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91191, rsp_expected=true, UNICAST3: DATA, seqno=266, TP: [cluster_name=ISPN] 09:59:00,331 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:37943 09:59:00,334 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,334 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:00,331 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,334 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:00,334 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,334 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:00,331 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #64, conn-id=1, ts=83) 09:59:00,334 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91191, rsp_expected=true, UNICAST3: DATA, seqno=266, TP: [cluster_name=ISPN] 09:59:00,335 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #266, conn_id=0) 09:59:00,335 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#266 09:59:00,335 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,335 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:00,335 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,334 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=265, ts=98, TP: [cluster_name=ISPN] 09:59:00,336 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #265, conn-id=0, ts=98) 09:59:00,335 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@39912890] 09:59:00,336 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,336 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:59:00,337 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=263, conn_id=2, ts=86, TP: [cluster_name=ISPN] 09:59:00,337 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #263, conn-id=2, ts=86) 09:59:00,336 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:00,341 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:59:00,341 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,341 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,341 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:00,347 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,347 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,350 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:00,353 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91198] on Test-NodeC-52778 09:59:00,353 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #264, conn_id=2) 09:59:00,353 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91198, rsp_expected=true, UNICAST3: DATA, seqno=264, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,353 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,358 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:00,360 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91198, rsp_expected=true, UNICAST3: DATA, seqno=264, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,368 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #264, conn_id=2) 09:59:00,368 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#264 09:59:00,368 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91198 09:59:00,368 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,368 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,369 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37945. timeout=10000 (MILLISECONDS) 09:59:00,369 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37945. Timeout=10000 (MILLISECONDS) 09:59:00,369 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37945} 09:59:00,369 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37945}. Current=null 09:59:00,369 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37945}) => true 09:59:00,369 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37945}. WAITING => ACQUIRED 09:59:00,369 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37945} successfully acquired the lock. 09:59:00,369 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3b9b1798] 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:37945. timeout=10000 (MILLISECONDS) 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37945. Timeout=10000 (MILLISECONDS) 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37945} 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(62d9c5bf){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,369 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:00,377 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91204] on Test-NodeB-10318 09:59:00,377 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #65, conn_id=1) 09:59:00,377 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91204, rsp_expected=true, UNICAST3: DATA, seqno=65, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,377 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,377 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:00,378 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91204, rsp_expected=true, UNICAST3: DATA, seqno=65, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,378 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #65, conn_id=1) 09:59:00,386 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#65 09:59:00,386 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91204 09:59:00,386 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:00,386 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,387 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,387 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,387 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,387 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7039b42b] 09:59:00,395 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,395 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:59:00,399 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:00,399 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:59:00,400 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,400 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,402 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:59:00,402 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(152ace41){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,406 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,406 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,414 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(152ace41){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91204 to Test-NodeC-52778 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #65, conn_id=1) 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91204, rsp_expected=true, UNICAST3: DATA, seqno=65, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,415 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37945 09:59:00,415 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,415 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:59:00,422 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91204, rsp_expected=true, UNICAST3: DATA, seqno=65, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,422 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #65, conn_id=1) 09:59:00,422 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#65 09:59:00,422 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,422 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:00,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(62d9c5bf){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:59:00,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:59:00,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37945 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37945. 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37945}. ACQUIRED => RELEASED 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37945}? true 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37945} 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37945}, null) => true 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91198 to Test-NodeA-7051 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #267, conn_id=0) 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91198, rsp_expected=true, UNICAST3: DATA, seqno=267, TP: [cluster_name=ISPN] 09:59:00,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:37945 09:59:00,424 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,424 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:00,425 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91198, rsp_expected=true, UNICAST3: DATA, seqno=267, TP: [cluster_name=ISPN] 09:59:00,429 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #267, conn_id=0) 09:59:00,429 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#267 09:59:00,429 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,429 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:00,429 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,429 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@51b6a2ab] 09:59:00,429 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,429 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:59:00,429 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:00,429 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:59:00,429 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,430 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,431 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:00,435 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,435 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,435 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:00,435 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91212] on Test-NodeC-52778 09:59:00,436 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #265, conn_id=2) 09:59:00,436 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91212, rsp_expected=true, UNICAST3: DATA, seqno=265, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,439 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,439 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91212, rsp_expected=true, UNICAST3: DATA, seqno=265, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #265, conn_id=2) 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#265 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91212 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37957. timeout=10000 (MILLISECONDS) 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37957. Timeout=10000 (MILLISECONDS) 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37957} 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37957}. Current=null 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37957}) => true 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37957}. WAITING => ACQUIRED 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37957} successfully acquired the lock. 09:59:00,440 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,440 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,441 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@25eb9aab] 09:59:00,441 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,441 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:37957. timeout=10000 (MILLISECONDS) 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37957. Timeout=10000 (MILLISECONDS) 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37957} 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(496d9f6b){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91215] on Test-NodeA-7051 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #268, conn_id=0) 09:59:00,442 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91215, rsp_expected=true, UNICAST3: DATA, seqno=268, TP: [cluster_name=ISPN] 09:59:00,440 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,442 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,446 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:00,447 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91215, rsp_expected=true, UNICAST3: DATA, seqno=268, TP: [cluster_name=ISPN] 09:59:00,447 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #268, conn_id=0) 09:59:00,447 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#268 09:59:00,453 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91215 09:59:00,455 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:00,455 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,456 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,456 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,456 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,458 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@59825462] 09:59:00,458 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,458 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:59:00,458 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:00,469 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:59:00,469 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,476 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,477 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:59:00,495 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(220e0472){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,495 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(220e0472){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91215 to Test-NodeC-52778 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #266, conn_id=2) 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91215, rsp_expected=true, UNICAST3: DATA, seqno=266, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,496 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37957 09:59:00,496 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,498 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:00,507 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91215, rsp_expected=true, UNICAST3: DATA, seqno=266, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,509 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #266, conn_id=2) 09:59:00,510 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#266 09:59:00,510 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,510 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:00,512 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(496d9f6b){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,512 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:59:00,516 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,517 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,517 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:59:00,517 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:59:00,517 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,517 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37957 09:59:00,517 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37957. 09:59:00,518 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37957}. ACQUIRED => RELEASED 09:59:00,519 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37957}? true 09:59:00,521 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37957} 09:59:00,529 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37957}, null) => true 09:59:00,530 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:00,537 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,537 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91212 to Test-NodeA-7051 09:59:00,537 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #269, conn_id=0) 09:59:00,537 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91212, rsp_expected=true, UNICAST3: DATA, seqno=269, TP: [cluster_name=ISPN] 09:59:00,537 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:37957 09:59:00,538 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,538 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:00,538 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91212, rsp_expected=true, UNICAST3: DATA, seqno=269, TP: [cluster_name=ISPN] 09:59:00,538 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #269, conn_id=0) 09:59:00,538 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#269 09:59:00,538 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,546 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:00,551 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,551 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3d9cfe13] 09:59:00,552 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,552 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:59:00,552 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:37967. timeout=10000 (MILLISECONDS) 09:59:00,553 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37967. Timeout=10000 (MILLISECONDS) 09:59:00,553 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37967} 09:59:00,554 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37967}. Current=null 09:59:00,554 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37967}) => true 09:59:00,555 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37967}. WAITING => ACQUIRED 09:59:00,556 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37967} successfully acquired the lock. 09:59:00,556 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:59:00,559 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:59:00,561 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,563 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,563 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:59:00,565 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(e2adc24){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,568 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,569 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,570 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:59:00,570 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,571 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,571 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:00,571 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91229] on Test-NodeB-10318 09:59:00,571 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #150, conn_id=1) 09:59:00,571 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91229, rsp_expected=true, UNICAST3: DATA, seqno=150, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,571 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,574 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:00,575 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91229, rsp_expected=true, UNICAST3: DATA, seqno=150, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,575 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #150, conn_id=1) 09:59:00,575 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#150 09:59:00,582 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91229 09:59:00,582 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,583 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,583 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3ca891c9] 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,583 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:59:00,594 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6b6e84c3){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,596 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,602 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,604 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6b6e84c3){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,623 TRACE (Timer-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:00,623 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:00,623 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:59:00,624 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:00,624 TRACE (INT-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeA-7051: mine: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:00,624 TRACE (INT-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:59:00,624 TRACE (INT-2,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:59:00,624 TRACE (INT-2,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 6 from Test-NodeA-7051 09:59:00,624 TRACE (INT-2,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 0 from Test-NodeB-10318 09:59:00,624 TRACE (INT-2,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 0 from Test-NodeC-52778 09:59:00,627 TRACE (Timer-3,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stability msg Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:00,627 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:00,627 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:59:00,627 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (120 bytes (600.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:59:00,627 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (123 bytes) 09:59:00,628 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:00,628 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (123 bytes) 09:59:00,628 TRACE (INT-1,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: received stability msg from Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:00,628 TRACE (INT-1,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:59:00,628 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:59:00,628 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 6 from Test-NodeA-7051 09:59:00,628 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 0 from Test-NodeB-10318 09:59:00,628 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 0 from Test-NodeC-52778 09:59:00,628 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:00,628 TRACE (INT-1,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: received stability msg from Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:00,627 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:00,628 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:59:00,631 TRACE (INT-1,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:59:00,631 TRACE (INT-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:59:00,631 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,633 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,634 TRACE (INT-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 6 from Test-NodeA-7051 09:59:00,634 TRACE (INT-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 0 from Test-NodeB-10318 09:59:00,634 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:59:00,637 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:59:00,635 TRACE (INT-1,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 0 from Test-NodeC-52778 09:59:00,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,649 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,649 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91229 to Test-NodeA-7051 09:59:00,650 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #152, conn_id=0) 09:59:00,651 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91229, rsp_expected=true, UNICAST3: DATA, seqno=152, TP: [cluster_name=ISPN] 09:59:00,652 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37967 09:59:00,652 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,652 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:00,656 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91229, rsp_expected=true, UNICAST3: DATA, seqno=152, TP: [cluster_name=ISPN] 09:59:00,661 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #152, conn_id=0) 09:59:00,661 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#152 09:59:00,663 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,663 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:00,663 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(e2adc24){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,667 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:59:00,668 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,670 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,676 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:59:00,677 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:59:00,678 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,678 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:37967 09:59:00,678 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37967. 09:59:00,678 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37967}. ACQUIRED => RELEASED 09:59:00,678 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37967}? true 09:59:00,678 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37967} 09:59:00,678 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37967}, null) => true 09:59:00,678 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:00,679 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@d806bb] 09:59:00,679 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,680 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:59:00,680 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:00,680 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:59:00,681 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,682 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,682 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:00,682 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,682 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,682 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:00,682 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91248] on Test-NodeC-52778 09:59:00,682 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #267, conn_id=2) 09:59:00,682 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91248, rsp_expected=true, UNICAST3: DATA, seqno=267, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,682 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,682 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:00,682 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91248, rsp_expected=true, UNICAST3: DATA, seqno=267, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,683 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #267, conn_id=2) 09:59:00,683 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#267 09:59:00,684 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91248 09:59:00,684 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,685 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,685 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37978. timeout=10000 (MILLISECONDS) 09:59:00,685 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37978. Timeout=10000 (MILLISECONDS) 09:59:00,686 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37978} 09:59:00,687 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37978}. Current=null 09:59:00,689 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37978}) => true 09:59:00,689 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37978}. WAITING => ACQUIRED 09:59:00,689 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37978} successfully acquired the lock. 09:59:00,689 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,689 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,690 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@76f73b3a] 09:59:00,690 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,690 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:59:00,690 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:37978. timeout=10000 (MILLISECONDS) 09:59:00,690 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37978. Timeout=10000 (MILLISECONDS) 09:59:00,689 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,690 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37978} 09:59:00,692 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:00,692 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:59:00,697 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,697 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,697 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:59:00,697 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5e12ffdc){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,698 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,698 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,698 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,703 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:00,703 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91255] on Test-NodeA-7051 09:59:00,704 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #270, conn_id=0) 09:59:00,704 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91255, rsp_expected=true, UNICAST3: DATA, seqno=270, TP: [cluster_name=ISPN] 09:59:00,706 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,706 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:00,706 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91255, rsp_expected=true, UNICAST3: DATA, seqno=270, TP: [cluster_name=ISPN] 09:59:00,706 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #270, conn_id=0) 09:59:00,708 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#270 09:59:00,709 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91255 09:59:00,712 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:00,712 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,716 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,716 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,716 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@17340cb3] 09:59:00,716 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,717 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:59:00,713 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,721 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:00,768 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(309e62a4){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(309e62a4){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91255 to Test-NodeC-52778 09:59:00,770 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #268, conn_id=2) 09:59:00,771 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91255, rsp_expected=true, UNICAST3: DATA, seqno=268, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,771 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37978 09:59:00,886 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #65) 09:59:00,887 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #150) 09:59:00,887 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=150, conn_id=1, ts=84, TP: [cluster_name=ISPN] 09:59:00,887 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #65) 09:59:00,887 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,887 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:00,887 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=150, conn_id=1, ts=84, TP: [cluster_name=ISPN] 09:59:00,771 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,890 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:00,887 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #150, conn-id=1, ts=84) 09:59:00,887 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #152) 09:59:00,896 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=152, ts=99, TP: [cluster_name=ISPN] 09:59:00,887 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=65, conn_id=1, ts=85, TP: [cluster_name=ISPN] 09:59:00,886 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=65, conn_id=1, ts=87, TP: [cluster_name=ISPN] 09:59:00,897 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #267) 09:59:00,897 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=267, conn_id=2, ts=88, TP: [cluster_name=ISPN] 09:59:00,897 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,900 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:00,900 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=65, conn_id=1, ts=87, TP: [cluster_name=ISPN] 09:59:00,901 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #65, conn-id=1, ts=87) 09:59:00,896 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,903 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:00,903 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #270) 09:59:00,903 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=270, ts=100, TP: [cluster_name=ISPN] 09:59:00,896 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91255, rsp_expected=true, UNICAST3: DATA, seqno=268, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,903 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=65, conn_id=1, ts=85, TP: [cluster_name=ISPN] 09:59:00,903 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (121 bytes (605.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:59:00,908 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:00,908 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:00,909 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=152, ts=99, TP: [cluster_name=ISPN] 09:59:00,909 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=270, ts=100, TP: [cluster_name=ISPN] 09:59:00,909 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #152, conn-id=0, ts=99) 09:59:00,903 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #65, conn-id=1, ts=85) 09:59:00,909 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #268, conn_id=2) 09:59:00,909 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#268 09:59:00,909 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,909 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:00,900 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,910 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:00,910 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=267, conn_id=2, ts=88, TP: [cluster_name=ISPN] 09:59:00,909 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5e12ffdc){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,911 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:59:00,911 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,911 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,911 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:59:00,911 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:59:00,911 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #270, conn-id=0, ts=100) 09:59:00,911 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,911 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #267, conn-id=2, ts=88) 09:59:00,916 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37978 09:59:00,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37978. 09:59:00,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37978}. ACQUIRED => RELEASED 09:59:00,921 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37978}? true 09:59:00,922 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37978} 09:59:00,922 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37978}, null) => true 09:59:00,922 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:00,922 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,922 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91248 to Test-NodeA-7051 09:59:00,922 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #271, conn_id=0) 09:59:00,922 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91248, rsp_expected=true, UNICAST3: DATA, seqno=271, TP: [cluster_name=ISPN] 09:59:00,922 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:37978 09:59:00,922 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,922 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:00,922 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91248, rsp_expected=true, UNICAST3: DATA, seqno=271, TP: [cluster_name=ISPN] 09:59:00,929 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #271, conn_id=0) 09:59:00,932 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#271 09:59:00,942 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,943 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:00,943 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,943 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2153e804] 09:59:00,943 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,943 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:59:00,943 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:00,943 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:59:00,943 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,943 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,943 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:00,944 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,944 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,944 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:00,944 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91268] on Test-NodeC-52778 09:59:00,944 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #269, conn_id=2) 09:59:00,944 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91268, rsp_expected=true, UNICAST3: DATA, seqno=269, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,944 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,944 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:00,944 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91268, rsp_expected=true, UNICAST3: DATA, seqno=269, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,946 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #269, conn_id=2) 09:59:00,946 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#269 09:59:00,946 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91268 09:59:00,946 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,946 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,946 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37987. timeout=10000 (MILLISECONDS) 09:59:00,947 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37987. Timeout=10000 (MILLISECONDS) 09:59:00,947 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37987} 09:59:00,947 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37987}. Current=null 09:59:00,947 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37987}) => true 09:59:00,947 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37987}. WAITING => ACQUIRED 09:59:00,947 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37987} successfully acquired the lock. 09:59:00,947 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,947 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,947 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,947 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@151a0c7c] 09:59:00,947 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,947 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:59:00,956 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:37987. timeout=10000 (MILLISECONDS) 09:59:00,956 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37987. Timeout=10000 (MILLISECONDS) 09:59:00,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37987} 09:59:00,969 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:00,969 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:59:00,970 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,970 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,971 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:59:00,971 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(202d7c84){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,975 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,977 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,977 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,985 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,985 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:00,985 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91274] on Test-NodeA-7051 09:59:00,985 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #272, conn_id=0) 09:59:00,985 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91274, rsp_expected=true, UNICAST3: DATA, seqno=272, TP: [cluster_name=ISPN] 09:59:00,985 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,985 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:00,985 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91274, rsp_expected=true, UNICAST3: DATA, seqno=272, TP: [cluster_name=ISPN] 09:59:00,985 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #272, conn_id=0) 09:59:00,985 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#272 09:59:00,985 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91274 09:59:00,985 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:00,985 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,985 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:00,985 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,985 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:00,985 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7bf41191] 09:59:00,985 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:00,985 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:59:00,985 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(290bb709){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(290bb709){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91274 to Test-NodeC-52778 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #270, conn_id=2) 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91274, rsp_expected=true, UNICAST3: DATA, seqno=270, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,986 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37987 09:59:00,986 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:00,986 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:00,986 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91274, rsp_expected=true, UNICAST3: DATA, seqno=270, conn_id=2, TP: [cluster_name=ISPN] 09:59:00,986 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #270, conn_id=2) 09:59:00,986 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#270 09:59:00,986 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,986 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(202d7c84){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37987 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37987. 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37987}. ACQUIRED => RELEASED 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37987}? true 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37987} 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37987}, null) => true 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91268 to Test-NodeA-7051 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #273, conn_id=0) 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91268, rsp_expected=true, UNICAST3: DATA, seqno=273, TP: [cluster_name=ISPN] 09:59:00,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:37987 09:59:00,986 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:00,987 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:00,987 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91268, rsp_expected=true, UNICAST3: DATA, seqno=273, TP: [cluster_name=ISPN] 09:59:00,987 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #273, conn_id=0) 09:59:00,987 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#273 09:59:00,987 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:00,987 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:00,987 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:00,987 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5af4b997] 09:59:00,987 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:00,987 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:59:00,987 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:00,987 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:59:00,987 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:00,987 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:00,987 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:00,987 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:00,987 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:00,987 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:00,987 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91275] on Test-NodeB-10318 09:59:00,987 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #151, conn_id=1) 09:59:00,987 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91275, rsp_expected=true, UNICAST3: DATA, seqno=151, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,987 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:00,987 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:00,987 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91275, rsp_expected=true, UNICAST3: DATA, seqno=151, conn_id=1, TP: [cluster_name=ISPN] 09:59:00,987 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #151, conn_id=1) 09:59:00,995 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#151 09:59:00,995 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91275 09:59:00,995 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:00,997 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:00,999 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37991. timeout=10000 (MILLISECONDS) 09:59:00,999 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37991. Timeout=10000 (MILLISECONDS) 09:59:01,000 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37991} 09:59:01,000 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37991}. Current=null 09:59:01,000 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:37991}) => true 09:59:01,000 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37991}. WAITING => ACQUIRED 09:59:01,001 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37991} successfully acquired the lock. 09:59:01,001 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,001 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,001 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,003 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@564bed69] 09:59:01,003 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,007 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:59:01,011 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:37991. timeout=10000 (MILLISECONDS) 09:59:01,012 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:37991. Timeout=10000 (MILLISECONDS) 09:59:01,013 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:37991} 09:59:01,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:01,014 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:59:01,016 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,018 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,018 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:59:01,020 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(15507927){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,034 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,034 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,035 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,037 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,042 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:01,042 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91289] on Test-NodeC-52778 09:59:01,042 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #66, conn_id=1) 09:59:01,042 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91289, rsp_expected=true, UNICAST3: DATA, seqno=66, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,042 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,045 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:59:01,045 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91289, rsp_expected=true, UNICAST3: DATA, seqno=66, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,046 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #66, conn_id=1) 09:59:01,046 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#66 09:59:01,047 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91289 09:59:01,047 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:01,047 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,048 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,048 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,050 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,050 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2270e2d0] 09:59:01,051 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,051 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:59:01,051 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:01,052 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:59:01,052 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,052 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:59:01,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(16d4d1a1){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(16d4d1a1){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91289 to Test-NodeB-10318 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #66, conn_id=1) 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91289, rsp_expected=true, UNICAST3: DATA, seqno=66, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,054 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:37991 09:59:01,054 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,054 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:01,056 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91289, rsp_expected=true, UNICAST3: DATA, seqno=66, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,063 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #66, conn_id=1) 09:59:01,065 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#66 09:59:01,065 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,068 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:01,069 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(15507927){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,070 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:59:01,081 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,081 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,081 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:59:01,082 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:59:01,082 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,083 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37991 09:59:01,083 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:37991. 09:59:01,083 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37991}. ACQUIRED => RELEASED 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37991}? true 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37991} 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:37991}, null) => true 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91275 to Test-NodeA-7051 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #153, conn_id=0) 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91275, rsp_expected=true, UNICAST3: DATA, seqno=153, TP: [cluster_name=ISPN] 09:59:01,084 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:37991 09:59:01,084 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,084 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:01,092 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91275, rsp_expected=true, UNICAST3: DATA, seqno=153, TP: [cluster_name=ISPN] 09:59:01,092 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #153, conn_id=0) 09:59:01,095 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#153 09:59:01,095 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,105 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:01,105 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,105 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4f2cdd00] 09:59:01,105 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:01,105 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:59:01,105 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:01,105 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:59:01,105 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,105 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,105 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:01,105 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,105 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,105 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:01,106 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91304] on Test-NodeC-52778 09:59:01,106 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #271, conn_id=2) 09:59:01,106 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91304, rsp_expected=true, UNICAST3: DATA, seqno=271, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,106 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,106 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:01,115 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91304, rsp_expected=true, UNICAST3: DATA, seqno=271, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,115 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #271, conn_id=2) 09:59:01,115 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#271 09:59:01,115 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91304 09:59:01,115 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:01,115 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,119 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:38005. timeout=10000 (MILLISECONDS) 09:59:01,119 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38005. Timeout=10000 (MILLISECONDS) 09:59:01,119 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38005} 09:59:01,121 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38005}. Current=null 09:59:01,121 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38005}) => true 09:59:01,121 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38005}. WAITING => ACQUIRED 09:59:01,121 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38005} successfully acquired the lock. 09:59:01,121 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,121 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,124 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,124 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7d54689e] 09:59:01,124 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,124 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:38005. timeout=10000 (MILLISECONDS) 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38005. Timeout=10000 (MILLISECONDS) 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38005} 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7498c406){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91311] on Test-NodeA-7051 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #274, conn_id=0) 09:59:01,132 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91311, rsp_expected=true, UNICAST3: DATA, seqno=274, TP: [cluster_name=ISPN] 09:59:01,132 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,133 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:01,135 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91311, rsp_expected=true, UNICAST3: DATA, seqno=274, TP: [cluster_name=ISPN] 09:59:01,162 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #274, conn_id=0) 09:59:01,162 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#274 09:59:01,162 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91311 09:59:01,163 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:01,186 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,186 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,186 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,189 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,206 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1e6d770f] 09:59:01,206 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,206 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:59:01,206 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5da5bd24){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5da5bd24){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91311 to Test-NodeC-52778 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #272, conn_id=2) 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91311, rsp_expected=true, UNICAST3: DATA, seqno=272, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,207 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38005 09:59:01,207 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,207 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:01,208 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91311, rsp_expected=true, UNICAST3: DATA, seqno=272, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,208 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #272, conn_id=2) 09:59:01,208 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#272 09:59:01,208 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,208 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7498c406){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:38005 09:59:01,209 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38005. 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38005}. ACQUIRED => RELEASED 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38005}? true 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38005} 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38005}, null) => true 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91304 to Test-NodeA-7051 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #275, conn_id=0) 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91304, rsp_expected=true, UNICAST3: DATA, seqno=275, TP: [cluster_name=ISPN] 09:59:01,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:38005 09:59:01,210 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,210 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:01,213 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91304, rsp_expected=true, UNICAST3: DATA, seqno=275, TP: [cluster_name=ISPN] 09:59:01,213 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #275, conn_id=0) 09:59:01,228 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#275 09:59:01,233 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,233 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:01,233 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,233 DEBUG (testng-Test:[]) [Test] Found key key-to-change-1 with primary owner Test-NodeA-7051, segment 175 09:59:01,233 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7b002392] 09:59:01,233 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:01,233 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-1'? true 09:59:01,233 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change-1 for owner=CommandInvocation:Test-NodeA-7051:38012. timeout=10000 (MILLISECONDS) 09:59:01,233 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38012. Timeout=10000 (MILLISECONDS) 09:59:01,233 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38012} 09:59:01,233 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38012}. Current=null 09:59:01,233 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38012}) => true 09:59:01,233 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38012}. WAITING => ACQUIRED 09:59:01,233 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38012} successfully acquired the lock. 09:59:01,233 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:59:01,233 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:59:01,233 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,233 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,233 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:59:01,234 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(f1d65cb){key=key-to-change-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,234 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,234 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,234 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:59:01,234 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,234 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,234 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:01,234 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91318] on Test-NodeB-10318 09:59:01,234 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #152, conn_id=1) 09:59:01,234 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91318, rsp_expected=true, UNICAST3: DATA, seqno=152, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,234 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (208 bytes (1040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,234 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (211 bytes) 09:59:01,234 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=134 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91318, rsp_expected=true, UNICAST3: DATA, seqno=152, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,234 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #152, conn_id=1) 09:59:01,234 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#152 09:59:01,234 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91318 09:59:01,234 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:01,234 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,234 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4cc6331d] 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change-1'? false 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(317c9b17){key=key-to-change-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(317c9b17){key=key-to-change-1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,234 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:59:01,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-1, value=initial-value} in container 09:59:01,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91318 to Test-NodeA-7051 09:59:01,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #154, conn_id=0) 09:59:01,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91318, rsp_expected=true, UNICAST3: DATA, seqno=154, TP: [cluster_name=ISPN] 09:59:01,235 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38012 09:59:01,235 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,235 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:01,235 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91318, rsp_expected=true, UNICAST3: DATA, seqno=154, TP: [cluster_name=ISPN] 09:59:01,235 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #154, conn_id=0) 09:59:01,235 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#154 09:59:01,235 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,235 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change-1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:01,235 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(f1d65cb){key=key-to-change-1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,235 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:59:01,235 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,235 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,235 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:59:01,235 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change-1, value=initial-value} in container 09:59:01,235 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,235 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change-1]. owner=CommandInvocation:Test-NodeA-7051:38012 09:59:01,235 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38012. 09:59:01,235 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38012}. ACQUIRED => RELEASED 09:59:01,235 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38012}? true 09:59:01,235 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38012} 09:59:01,235 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38012}, null) => true 09:59:01,235 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:01,235 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21574644] 09:59:01,235 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,235 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:59:01,236 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-1 for read. Entry=ImmortalCacheEntry{key=key-to-change-1, value=initial-value} 09:59:01,236 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:59:01,236 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:59:01,237 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=key-to-change-1, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@633fa7ca] 09:59:01,237 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,237 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:59:01,237 TRACE (testng-Test:[]) [EntryFactoryImpl] Wrap key-to-change-1 for read. Entry=ImmortalCacheEntry{key=key-to-change-1, value=initial-value} 09:59:01,237 TRACE (testng-Test:[]) [CallInterceptor] Invoking: GetKeyValueCommand 09:59:01,237 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[]. owner=null 09:59:01,239 DEBUG (testng-Test:[]) [ServiceFinder] No service impls found: FilterIndexingServiceProvider 09:59:01,239 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_complete_segment_invoked * 1 09:59:01,239 TRACE (ForkThread-1,Test:[]) [Test] Started fork runnable.. 09:59:01,240 TRACE (ForkThread-1,Test:[]) [Test] Adding segment listener 827b858f-9cf2-4b1a-8c14-a089dcb3cd16 : org.infinispan.notifications.cachelistener.DistributedQueueingSegmentListener@1e1ca6c9 09:59:01,240 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 827b858f-9cf2-4b1a-8c14-a089dcb3cd16 09:59:01,240 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@7560e932[Not completed] to remote execution at node Test-NodeB-10318 09:59:01,241 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5e13a2ce] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,241 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5e13a2ce], mode=SYNCHRONOUS, timeout=15000 09:59:01,242 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5e13a2ce] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:01,243 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91322] on Test-NodeB-10318 09:59:01,244 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #153, conn_id=1) 09:59:01,244 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91322, rsp_expected=true, UNICAST3: DATA, seqno=153, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,244 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@17edd9e6[Not completed] to remote execution at node Test-NodeC-52778 09:59:01,244 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5e13a2ce] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,244 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5e13a2ce], mode=SYNCHRONOUS, timeout=15000 09:59:01,245 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5e13a2ce] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:01,245 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,252 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:59:01,245 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91323] on Test-NodeC-52778 09:59:01,253 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #273, conn_id=2) 09:59:01,253 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91322, rsp_expected=true, UNICAST3: DATA, seqno=153, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,253 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #153, conn_id=1) 09:59:01,253 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#153 09:59:01,253 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91322 09:59:01,253 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@449c14f9] [sender=Test-NodeA-7051] 09:59:01,253 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91323, rsp_expected=true, UNICAST3: DATA, seqno=273, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,254 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (237 bytes (1185.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,256 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (240 bytes) 09:59:01,256 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91323, rsp_expected=true, UNICAST3: DATA, seqno=273, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,256 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #273, conn_id=2) 09:59:01,256 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#273 09:59:01,256 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91323 09:59:01,257 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3766d13a] [sender=Test-NodeA-7051] 09:59:01,257 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:01,257 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,254 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:01,257 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,257 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@449c14f9] 09:59:01,257 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 827b858f-9cf2-4b1a-8c14-a089dcb3cd16 09:59:01,260 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@449c14f9] 09:59:01,260 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91322 to Test-NodeA-7051 09:59:01,260 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #155, conn_id=0) 09:59:01,260 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91322, rsp_expected=true, UNICAST3: DATA, seqno=155, TP: [cluster_name=ISPN] 09:59:01,257 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3766d13a] 09:59:01,260 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,264 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 827b858f-9cf2-4b1a-8c14-a089dcb3cd16 09:59:01,261 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:01,265 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91322, rsp_expected=true, UNICAST3: DATA, seqno=155, TP: [cluster_name=ISPN] 09:59:01,266 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@3766d13a] 09:59:01,266 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91323 to Test-NodeA-7051 09:59:01,268 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #276, conn_id=0) 09:59:01,268 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91323, rsp_expected=true, UNICAST3: DATA, seqno=276, TP: [cluster_name=ISPN] 09:59:01,268 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,267 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #155, conn_id=0) 09:59:01,268 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#155 09:59:01,268 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:01,268 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91323, rsp_expected=true, UNICAST3: DATA, seqno=276, TP: [cluster_name=ISPN] 09:59:01,268 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #276, conn_id=0) 09:59:01,269 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#276 09:59:01,269 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,269 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5e13a2ce] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:01,269 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,279 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@5e13a2ce] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:01,279 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 827b858f-9cf2-4b1a-8c14-a089dcb3cd16 requests initial state for cache 09:59:01,279 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@62b6889c] 09:59:01,280 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:01,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:59:01,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705115 09:59:01,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705115 excluding keys [] 09:59:01,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:59:01,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:01,280 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:01,281 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91326] on Test-NodeB-10318 09:59:01,281 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #154, conn_id=1) 09:59:01,281 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91326, rsp_expected=true, UNICAST3: DATA, seqno=154, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,281 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,281 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:59:01,281 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91326, rsp_expected=true, UNICAST3: DATA, seqno=154, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,283 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #154, conn_id=1) 09:59:01,286 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#154 09:59:01,291 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91326 09:59:01,291 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:59:01,291 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,291 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,291 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:01,291 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705115 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:01,291 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@24190cb5] 09:59:01,291 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:01,291 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705115 09:59:01,292 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705115 09:59:01,292 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705115 09:59:01,292 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:01,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705115 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:59:01,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705115 09:59:01,293 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,299 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:01,300 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:01,301 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91328] on Test-NodeA-7051 09:59:01,301 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #156, conn_id=0) 09:59:01,302 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91328, rsp_expected=true, UNICAST3: DATA, seqno=156, TP: [cluster_name=ISPN] 09:59:01,303 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (225 bytes (1125.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,304 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (228 bytes) 09:59:01,310 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=151 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91328, rsp_expected=true, UNICAST3: DATA, seqno=156, TP: [cluster_name=ISPN] 09:59:01,310 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #156, conn_id=0) 09:59:01,310 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#156 09:59:01,310 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91328 09:59:01,310 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:59:01,310 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:01,310 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705115 with [] suspected segments. 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 117, 247, 248, 252, 254, 127] 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91328 to Test-NodeB-10318 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #155, conn_id=1) 09:59:01,313 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91328, rsp_expected=true, UNICAST3: DATA, seqno=155, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,314 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,314 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:59:01,314 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91328, rsp_expected=true, UNICAST3: DATA, seqno=155, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,314 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #155, conn_id=1) 09:59:01,314 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#155 09:59:01,314 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:59:01,314 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:01,314 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:01,314 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91326 to Test-NodeA-7051 09:59:01,316 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #157, conn_id=0) 09:59:01,316 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91326, rsp_expected=true, UNICAST3: DATA, seqno=157, TP: [cluster_name=ISPN] 09:59:01,316 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,316 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:59:01,317 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91326, rsp_expected=true, UNICAST3: DATA, seqno=157, TP: [cluster_name=ISPN] 09:59:01,317 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #157, conn_id=0) 09:59:01,320 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#157 09:59:01,320 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:59:01,328 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:01,328 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705115 excluding keys [] 09:59:01,331 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,331 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:59:01,331 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:01,333 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:01,333 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91331] on Test-NodeC-52778 09:59:01,335 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #274, conn_id=2) 09:59:01,335 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91331, rsp_expected=true, UNICAST3: DATA, seqno=274, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,345 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (608 bytes (3040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,345 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (611 bytes) 09:59:01,346 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91331, rsp_expected=true, UNICAST3: DATA, seqno=274, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,347 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #274, conn_id=2) 09:59:01,347 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#274 09:59:01,348 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91331 09:59:01,348 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:59:01,348 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,349 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:01,350 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705115 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:01,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@71b1b3ec] 09:59:01,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:01,352 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705115 09:59:01,353 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705115 09:59:01,353 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705115 09:59:01,355 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:01,355 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Request Test-NodeA-705115 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:59:01,356 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705115 09:59:01,356 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,356 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:01,356 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:01,356 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91334] on Test-NodeA-7051 09:59:01,356 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #277, conn_id=0) 09:59:01,356 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91334, rsp_expected=true, UNICAST3: DATA, seqno=277, TP: [cluster_name=ISPN] 09:59:01,356 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (316 bytes (1580.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,356 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (319 bytes) 09:59:01,357 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=241 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91334, rsp_expected=true, UNICAST3: DATA, seqno=277, TP: [cluster_name=ISPN] 09:59:01,357 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #277, conn_id=0) 09:59:01,357 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#277 09:59:01,357 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91334 09:59:01,357 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:59:01,357 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:01,357 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,357 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:01,357 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705115 with [] suspected segments. 09:59:01,360 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:01,360 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:59:01,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [Test] Completed segments [129, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 180, 181, 60, 63, 67, 195, 69, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 103, 107, 108, 236, 239, 240, 113, 241, 245, 119, 120, 249, 122, 124, 253] 09:59:01,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705115 as completed! 09:59:01,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:01,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91334 to Test-NodeC-52778 09:59:01,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #275, conn_id=2) 09:59:01,366 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91334, rsp_expected=true, UNICAST3: DATA, seqno=275, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,366 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,366 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (80 bytes) 09:59:01,366 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91334, rsp_expected=true, UNICAST3: DATA, seqno=275, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,366 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #275, conn_id=2) 09:59:01,366 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#275 09:59:01,366 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:59:01,366 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:01,366 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:01,366 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91331 to Test-NodeA-7051 09:59:01,366 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #278, conn_id=0) 09:59:01,366 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91331, rsp_expected=true, UNICAST3: DATA, seqno=278, TP: [cluster_name=ISPN] 09:59:01,366 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,369 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (80 bytes) 09:59:01,370 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91331, rsp_expected=true, UNICAST3: DATA, seqno=278, TP: [cluster_name=ISPN] 09:59:01,370 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #278, conn_id=0) 09:59:01,377 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#278 09:59:01,380 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,380 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-0 09:59:01,380 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 129 09:59:01,380 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 130 09:59:01,380 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 131 09:59:01,377 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:59:01,381 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:01,380 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 4 09:59:01,381 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:01,383 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 2 for id Test-NodeA-705115 09:59:01,383 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:01,383 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 132 09:59:01,383 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 2 09:59:01,383 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [Test] Completed segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:01,383 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 133 09:59:01,397 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #155) 09:59:01,397 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=155, conn_id=1, ts=86, TP: [cluster_name=ISPN] 09:59:01,397 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #66) 09:59:01,397 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=66, conn_id=1, ts=87, TP: [cluster_name=ISPN] 09:59:01,397 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,397 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:01,397 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,397 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:01,397 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=155, conn_id=1, ts=86, TP: [cluster_name=ISPN] 09:59:01,397 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #155, conn-id=1, ts=86) 09:59:01,397 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=66, conn_id=1, ts=87, TP: [cluster_name=ISPN] 09:59:01,397 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #66, conn-id=1, ts=87) 09:59:01,385 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705115 09:59:01,384 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 135 09:59:01,398 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 8 09:59:01,397 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705115 being completed: true 09:59:01,400 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #66) 09:59:01,400 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=66, conn_id=1, ts=89, TP: [cluster_name=ISPN] 09:59:01,400 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #275) 09:59:01,400 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,400 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:01,401 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=66, conn_id=1, ts=89, TP: [cluster_name=ISPN] 09:59:01,401 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #66, conn-id=1, ts=89) 09:59:01,401 TRACE (async-thread-Test-NodeA-p23741-t4:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705115 09:59:01,399 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 10 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 139 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 14 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 15 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 16 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 18 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 19 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 147 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 148 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 21 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 151 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 153 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 30 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 158 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 31 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 159 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 164 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 40 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 41 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 45 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 47 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 180 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 181 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 60 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 63 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 67 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 195 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 69 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 201 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 74 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 203 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 76 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 205 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 78 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 81 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 82 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 210 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 83 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 85 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 86 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 90 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 219 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 93 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 94 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 222 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 96 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 224 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 98 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 99 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 227 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 228 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 103 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 107 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 108 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 236 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 239 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 240 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 113 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 241 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 245 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 119 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 120 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 249 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 122 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 124 09:59:01,401 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 253 09:59:01,401 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [244, 251] 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-8 09:59:01,402 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:59:01,402 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-1 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-4 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-3 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,402 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-2 09:59:01,403 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #157) 09:59:01,403 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=157, ts=101, TP: [cluster_name=ISPN] 09:59:01,403 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #278) 09:59:01,403 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,400 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=275, conn_id=2, ts=90, TP: [cluster_name=ISPN] 09:59:01,403 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,403 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:01,403 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=278, ts=102, TP: [cluster_name=ISPN] 09:59:01,403 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,416 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-9 09:59:01,416 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,416 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,416 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-7 09:59:01,416 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:01,417 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=275, conn_id=2, ts=90, TP: [cluster_name=ISPN] 09:59:01,417 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #275, conn-id=2, ts=90) 09:59:01,416 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [48, 2, 229, 118, 71, 72, 233] 09:59:01,416 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:01,417 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=278, ts=102, TP: [cluster_name=ISPN] 09:59:01,418 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #278, conn-id=0, ts=102) 09:59:01,417 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,420 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=157, ts=101, TP: [cluster_name=ISPN] 09:59:01,420 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #157, conn-id=0, ts=101) 09:59:01,418 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-6 09:59:01,426 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:59:01,427 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:59:01,439 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:59:01,439 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:59:01,439 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:59:01,439 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:59:01,439 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:59:01,440 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,440 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-5 09:59:01,440 TRACE (ForkThread-1,Test:[]) [Test] Completed segments [24, 175] 09:59:01,440 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-1, value=initial-value, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,440 TRACE (ForkThread-1,Test:[]) [Test] Notified for key key-to-change-1 09:59:01,440 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_complete_segment_invoked * 1 (available = 1, total = 1) 09:59:01,440 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_complete_segment_released * 1 09:59:01,443 TRACE (testng-Test:[]) [CheckPoint] Received event pre_complete_segment_invoked * 1 (available = 0, total = 1) 09:59:01,443 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6e6d11d0] 09:59:01,443 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id -1 09:59:01,443 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change-1'? true 09:59:01,443 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change-1 for owner=CommandInvocation:Test-NodeA-7051:38034. timeout=10000 (MILLISECONDS) 09:59:01,444 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38034. Timeout=10000 (MILLISECONDS) 09:59:01,444 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38034} 09:59:01,444 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38034}. Current=null 09:59:01,450 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38034}) => true 09:59:01,450 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38034}. WAITING => ACQUIRED 09:59:01,454 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38034} successfully acquired the lock. 09:59:01,454 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:59:01,454 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:59:01,454 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,454 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:59:01,459 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:59:01,460 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3f534ad4){key=key-to-change-1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:01,462 TRACE (testng-Test:[]) [CallInterceptor] Invoking: RemoveCommand 09:59:01,462 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,462 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:59:01,467 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,477 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,477 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:01,477 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91353] on Test-NodeB-10318 09:59:01,477 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #156, conn_id=1) 09:59:01,477 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91353, rsp_expected=true, UNICAST3: DATA, seqno=156, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (173 bytes (865.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (176 bytes) 09:59:01,478 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=99 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91353, rsp_expected=true, UNICAST3: DATA, seqno=156, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,478 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #156, conn_id=1) 09:59:01,484 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#156 09:59:01,484 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91353 09:59:01,499 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeA-7051] 09:59:01,499 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,501 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,501 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:59:01,501 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:59:01,502 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@170a81ff] 09:59:01,503 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:59:01,504 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change-1'? false 09:59:01,509 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:01,509 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change-1'? true 09:59:01,509 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change-1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:59:01,515 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change-1 09:59:01,515 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2b46e590){key=key-to-change-1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:01,515 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: RemoveCommand 09:59:01,517 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,518 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2b46e590){key=key-to-change-1, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:01,518 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:59:01,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:59:01,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:59:01,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:59:01,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91353 to Test-NodeA-7051 09:59:01,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #158, conn_id=0) 09:59:01,521 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91353, rsp_expected=true, UNICAST3: DATA, seqno=158, TP: [cluster_name=ISPN] 09:59:01,522 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38034 09:59:01,522 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,529 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:59:01,530 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91353, rsp_expected=true, UNICAST3: DATA, seqno=158, TP: [cluster_name=ISPN] 09:59:01,530 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #158, conn_id=0) 09:59:01,531 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#158 09:59:01,532 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:59:01,533 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change-1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:59:01,533 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3f534ad4){key=key-to-change-1, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:01,533 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change-1. Operation Flag=null, L1 invalidation=false 09:59:01,533 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,535 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change-1 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:59:01,536 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:59:01,537 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change-1]. owner=CommandInvocation:Test-NodeA-7051:38034 09:59:01,540 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38034. 09:59:01,540 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38034}. ACQUIRED => RELEASED 09:59:01,540 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38034}? true 09:59:01,540 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38034} 09:59:01,540 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38034}, null) => true 09:59:01,540 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:01,540 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_complete_segment_released * 999999999 (available = 999999999, total = 999999999) 09:59:01,540 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_complete_segment_released * 1 (available = 999999998, total = 999999999) 09:59:01,541 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:59:01,542 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:59:01,545 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change-1, value=null, oldValue=initial-value, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:01,547 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 827b858f-9cf2-4b1a-8c14-a089dcb3cd16 initial state for cache completed 09:59:01,547 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork runnable. 09:59:01,551 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@7a84d4ae[Not completed] to self 09:59:01,552 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@5adbade0[Not completed] to remote execution at node Test-NodeB-10318 09:59:01,552 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@789c90cf] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,552 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@789c90cf], mode=SYNCHRONOUS, timeout=15000 09:59:01,552 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@789c90cf] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:01,552 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91367] on Test-NodeB-10318 09:59:01,552 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #157, conn_id=1) 09:59:01,552 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91367, rsp_expected=true, UNICAST3: DATA, seqno=157, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,552 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@3340a066[Not completed] to remote execution at node Test-NodeC-52778 09:59:01,552 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@789c90cf] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,552 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@789c90cf], mode=SYNCHRONOUS, timeout=15000 09:59:01,552 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@789c90cf] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:01,552 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91368] on Test-NodeC-52778 09:59:01,552 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #276, conn_id=2) 09:59:01,552 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91368, rsp_expected=true, UNICAST3: DATA, seqno=276, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,552 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,553 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:59:01,553 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (213 bytes (1065.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,554 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (216 bytes) 09:59:01,554 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91368, rsp_expected=true, UNICAST3: DATA, seqno=276, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,554 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #276, conn_id=2) 09:59:01,554 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91367, rsp_expected=true, UNICAST3: DATA, seqno=157, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,554 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #157, conn_id=1) 09:59:01,554 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#157 09:59:01,554 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91367 09:59:01,554 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@435a69ec] [sender=Test-NodeA-7051] 09:59:01,554 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:01,554 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,554 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@435a69ec] 09:59:01,554 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 827b858f-9cf2-4b1a-8c14-a089dcb3cd16 09:59:01,554 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#276 09:59:01,561 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@435a69ec] 09:59:01,561 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91367 to Test-NodeA-7051 09:59:01,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #159, conn_id=0) 09:59:01,563 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91368 09:59:01,563 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91367, rsp_expected=true, UNICAST3: DATA, seqno=159, TP: [cluster_name=ISPN] 09:59:01,564 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@70b84e3b] [sender=Test-NodeA-7051] 09:59:01,564 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:01,564 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,564 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:01,565 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91367, rsp_expected=true, UNICAST3: DATA, seqno=159, TP: [cluster_name=ISPN] 09:59:01,565 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #159, conn_id=0) 09:59:01,565 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#159 09:59:01,565 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,565 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@789c90cf] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:01,565 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,565 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@70b84e3b] 09:59:01,565 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 827b858f-9cf2-4b1a-8c14-a089dcb3cd16 09:59:01,565 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@70b84e3b] 09:59:01,565 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91368 to Test-NodeA-7051 09:59:01,565 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #279, conn_id=0) 09:59:01,565 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91368, rsp_expected=true, UNICAST3: DATA, seqno=279, TP: [cluster_name=ISPN] 09:59:01,566 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,566 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:01,566 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91368, rsp_expected=true, UNICAST3: DATA, seqno=279, TP: [cluster_name=ISPN] 09:59:01,567 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #279, conn_id=0) 09:59:01,567 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#279 09:59:01,569 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,569 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@789c90cf] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:01,570 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganAndSegmentNotCompleteValueOwnerClustered 09:59:01,570 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:59:01,570 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:59:01,570 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:59:01,570 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:59:01,570 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:01,570 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:59:01,570 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:59:01,576 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:01,595 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:59:01,595 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:59:01,596 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:01,599 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:59:01,600 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:59:01,600 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:59:01,600 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganButNotIteratedValueYetNonOwnerClustered 09:59:01,600 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@45be3db6] 09:59:01,600 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:01,600 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:59:01,600 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:01,600 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:59:01,600 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,600 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,600 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:01,600 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,600 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,600 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:01,600 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91378] on Test-NodeB-10318 09:59:01,600 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #158, conn_id=1) 09:59:01,600 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91378, rsp_expected=true, UNICAST3: DATA, seqno=158, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,600 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,601 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:01,602 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91378, rsp_expected=true, UNICAST3: DATA, seqno=158, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,602 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #158, conn_id=1) 09:59:01,602 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#158 09:59:01,602 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91378 09:59:01,602 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:01,603 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,603 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:38045. timeout=10000 (MILLISECONDS) 09:59:01,611 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38045. Timeout=10000 (MILLISECONDS) 09:59:01,611 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38045} 09:59:01,611 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38045}. Current=null 09:59:01,611 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38045}) => true 09:59:01,611 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38045}. WAITING => ACQUIRED 09:59:01,611 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38045} successfully acquired the lock. 09:59:01,611 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,611 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,612 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@39d987ac] 09:59:01,615 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,615 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:59:01,615 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:38045. timeout=10000 (MILLISECONDS) 09:59:01,616 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38045. Timeout=10000 (MILLISECONDS) 09:59:01,616 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38045} 09:59:01,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:01,619 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:59:01,620 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,633 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,636 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:59:01,636 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(66941a13){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,647 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,647 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,651 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:01,797 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91389] on Test-NodeC-52778 09:59:01,801 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #67, conn_id=1) 09:59:01,801 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91389, rsp_expected=true, UNICAST3: DATA, seqno=67, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,808 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,808 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:59:01,809 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91389, rsp_expected=true, UNICAST3: DATA, seqno=67, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,809 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #67, conn_id=1) 09:59:01,809 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#67 09:59:01,809 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91389 09:59:01,809 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:01,819 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,819 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,819 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,824 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,824 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@757508a5] 09:59:01,826 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,826 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:59:01,827 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:01,829 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:59:01,830 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,840 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:59:01,840 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5fbead0d){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,845 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,845 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5fbead0d){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,846 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:59:01,846 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,846 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,847 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:59:01,848 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:59:01,853 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,861 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,863 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91389 to Test-NodeB-10318 09:59:01,863 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #67, conn_id=1) 09:59:01,864 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91389, rsp_expected=true, UNICAST3: DATA, seqno=67, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,864 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,864 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38045 09:59:01,870 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:01,882 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91389, rsp_expected=true, UNICAST3: DATA, seqno=67, conn_id=1, TP: [cluster_name=ISPN] 09:59:01,882 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #67, conn_id=1) 09:59:01,886 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#67 09:59:01,886 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,886 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:01,886 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(66941a13){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:38045 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38045. 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38045}. ACQUIRED => RELEASED 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38045}? true 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38045} 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38045}, null) => true 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91378 to Test-NodeA-7051 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #160, conn_id=0) 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91378, rsp_expected=true, UNICAST3: DATA, seqno=160, TP: [cluster_name=ISPN] 09:59:01,888 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:38045 09:59:01,888 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,888 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:01,888 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91378, rsp_expected=true, UNICAST3: DATA, seqno=160, TP: [cluster_name=ISPN] 09:59:01,888 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #160, conn_id=0) 09:59:01,889 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#160 09:59:01,889 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,889 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:01,890 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,890 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1fb8de52] 09:59:01,890 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:01,890 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:59:01,890 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:01,890 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:59:01,890 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,890 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,890 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:01,890 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,890 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,890 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:01,890 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91403] on Test-NodeC-52778 09:59:01,890 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #277, conn_id=2) 09:59:01,897 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #158) 09:59:01,897 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=158, conn_id=1, ts=88, TP: [cluster_name=ISPN] 09:59:01,897 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,897 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91403, rsp_expected=true, UNICAST3: DATA, seqno=277, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,897 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #67) 09:59:01,897 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=67, conn_id=1, ts=89, TP: [cluster_name=ISPN] 09:59:01,897 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,897 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:01,899 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:01,899 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,899 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=158, conn_id=1, ts=88, TP: [cluster_name=ISPN] 09:59:01,900 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #158, conn-id=1, ts=88) 09:59:01,899 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:01,900 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91403, rsp_expected=true, UNICAST3: DATA, seqno=277, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,901 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #277, conn_id=2) 09:59:01,900 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=67, conn_id=1, ts=89, TP: [cluster_name=ISPN] 09:59:01,901 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #67, conn-id=1, ts=89) 09:59:01,901 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#277 09:59:01,903 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91403 09:59:01,903 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:01,903 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,903 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:38055. timeout=10000 (MILLISECONDS) 09:59:01,903 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #67) 09:59:01,905 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=67, conn_id=1, ts=91, TP: [cluster_name=ISPN] 09:59:01,905 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #277) 09:59:01,905 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,903 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38055. Timeout=10000 (MILLISECONDS) 09:59:01,905 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38055} 09:59:01,905 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:01,905 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=277, conn_id=2, ts=92, TP: [cluster_name=ISPN] 09:59:01,906 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,905 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38055}. Current=null 09:59:01,906 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:01,907 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=67, conn_id=1, ts=91, TP: [cluster_name=ISPN] 09:59:01,907 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #67, conn-id=1, ts=91) 09:59:01,908 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=277, conn_id=2, ts=92, TP: [cluster_name=ISPN] 09:59:01,908 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38055}) => true 09:59:01,908 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #277, conn-id=2, ts=92) 09:59:01,908 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38055}. WAITING => ACQUIRED 09:59:01,911 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38055} successfully acquired the lock. 09:59:01,911 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,911 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,913 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,914 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@35f35644] 09:59:01,914 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,916 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #160) 09:59:01,914 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:38055. timeout=10000 (MILLISECONDS) 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38055. Timeout=10000 (MILLISECONDS) 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38055} 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(58920679){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,923 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,924 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:01,924 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:01,924 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:01,924 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91408] on Test-NodeA-7051 09:59:01,924 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #280, conn_id=0) 09:59:01,924 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91408, rsp_expected=true, UNICAST3: DATA, seqno=280, TP: [cluster_name=ISPN] 09:59:01,924 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,924 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:01,916 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=160, ts=103, TP: [cluster_name=ISPN] 09:59:01,925 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #279) 09:59:01,925 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:01,925 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:01,925 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=279, ts=104, TP: [cluster_name=ISPN] 09:59:01,925 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,925 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:01,925 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=160, ts=103, TP: [cluster_name=ISPN] 09:59:01,925 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #160, conn-id=0, ts=103) 09:59:01,925 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=279, ts=104, TP: [cluster_name=ISPN] 09:59:01,925 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #279, conn-id=0, ts=104) 09:59:01,925 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91408, rsp_expected=true, UNICAST3: DATA, seqno=280, TP: [cluster_name=ISPN] 09:59:01,928 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #280, conn_id=0) 09:59:01,928 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#280 09:59:01,928 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91408 09:59:01,928 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:01,928 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:01,928 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:01,928 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,928 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:01,928 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7e1cff6] 09:59:01,928 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:01,931 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:59:01,931 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:01,931 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:59:01,933 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:01,933 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:01,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:59:01,937 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(77dd1eb3){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:01,938 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:01,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:01,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(77dd1eb3){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,940 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:59:01,941 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,943 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,945 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:59:01,948 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:59:01,952 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,952 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,952 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91408 to Test-NodeC-52778 09:59:01,952 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #278, conn_id=2) 09:59:01,952 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91408, rsp_expected=true, UNICAST3: DATA, seqno=278, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,952 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38055 09:59:01,952 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:01,952 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:01,952 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91408, rsp_expected=true, UNICAST3: DATA, seqno=278, conn_id=2, TP: [cluster_name=ISPN] 09:59:01,952 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #278, conn_id=2) 09:59:01,959 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#278 09:59:01,960 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,964 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:01,964 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(58920679){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:01,970 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:59:01,978 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:01,983 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:01,983 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:59:01,989 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:59:01,991 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:01,991 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:38055 09:59:01,993 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38055. 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38055}. ACQUIRED => RELEASED 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38055}? true 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38055} 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38055}, null) => true 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91403 to Test-NodeA-7051 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #281, conn_id=0) 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91403, rsp_expected=true, UNICAST3: DATA, seqno=281, TP: [cluster_name=ISPN] 09:59:01,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:38055 09:59:01,994 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:01,994 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:01,994 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91403, rsp_expected=true, UNICAST3: DATA, seqno=281, TP: [cluster_name=ISPN] 09:59:01,996 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #281, conn_id=0) 09:59:01,996 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#281 09:59:01,999 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:01,999 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,000 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,001 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@41acd3b1] 09:59:02,001 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,002 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:59:02,004 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:02,004 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:59:02,007 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,014 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,014 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:02,014 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,017 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,021 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:02,034 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91433] on Test-NodeC-52778 09:59:02,034 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #279, conn_id=2) 09:59:02,034 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91433, rsp_expected=true, UNICAST3: DATA, seqno=279, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,034 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,035 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:02,036 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91433, rsp_expected=true, UNICAST3: DATA, seqno=279, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,046 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #279, conn_id=2) 09:59:02,046 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#279 09:59:02,046 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91433 09:59:02,046 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:38063. timeout=10000 (MILLISECONDS) 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38063. Timeout=10000 (MILLISECONDS) 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38063} 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38063}. Current=null 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38063}) => true 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38063}. WAITING => ACQUIRED 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38063} successfully acquired the lock. 09:59:02,047 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,047 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,051 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2291090] 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:38063. timeout=10000 (MILLISECONDS) 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38063. Timeout=10000 (MILLISECONDS) 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38063} 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:59:02,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(6bcffbea){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,061 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,065 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,076 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,076 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,076 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:02,076 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91438] on Test-NodeB-10318 09:59:02,076 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #68, conn_id=1) 09:59:02,076 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91438, rsp_expected=true, UNICAST3: DATA, seqno=68, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,076 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,079 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:02,080 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91438, rsp_expected=true, UNICAST3: DATA, seqno=68, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,080 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #68, conn_id=1) 09:59:02,082 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#68 09:59:02,082 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91438 09:59:02,083 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:02,084 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,091 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2190f294] 09:59:02,093 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,108 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:59:02,108 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,108 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:59:02,112 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,112 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,113 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:59:02,113 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(665a0e95){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(665a0e95){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,115 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,118 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91438 to Test-NodeC-52778 09:59:02,121 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #68, conn_id=1) 09:59:02,121 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91438, rsp_expected=true, UNICAST3: DATA, seqno=68, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,121 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38063 09:59:02,121 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,121 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:59:02,121 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91438, rsp_expected=true, UNICAST3: DATA, seqno=68, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,133 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #68, conn_id=1) 09:59:02,140 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#68 09:59:02,140 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,140 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6bcffbea){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:38063 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38063. 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38063}. ACQUIRED => RELEASED 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38063}? true 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38063} 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38063}, null) => true 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91433 to Test-NodeA-7051 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #282, conn_id=0) 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91433, rsp_expected=true, UNICAST3: DATA, seqno=282, TP: [cluster_name=ISPN] 09:59:02,140 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:38063 09:59:02,140 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,141 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:02,141 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91433, rsp_expected=true, UNICAST3: DATA, seqno=282, TP: [cluster_name=ISPN] 09:59:02,141 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #282, conn_id=0) 09:59:02,141 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#282 09:59:02,141 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,141 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,141 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,141 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@215e5744] 09:59:02,141 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,141 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:59:02,141 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:02,141 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:59:02,141 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,141 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,141 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:02,141 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,141 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,141 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:02,141 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91451] on Test-NodeC-52778 09:59:02,141 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #280, conn_id=2) 09:59:02,141 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91451, rsp_expected=true, UNICAST3: DATA, seqno=280, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,141 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,141 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91451, rsp_expected=true, UNICAST3: DATA, seqno=280, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #280, conn_id=2) 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#280 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91451 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:38070. timeout=10000 (MILLISECONDS) 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38070. Timeout=10000 (MILLISECONDS) 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38070} 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38070}. Current=null 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38070}) => true 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38070}. WAITING => ACQUIRED 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38070} successfully acquired the lock. 09:59:02,142 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@8d9b6de] 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:38070. timeout=10000 (MILLISECONDS) 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38070. Timeout=10000 (MILLISECONDS) 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38070} 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2009f685){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91452] on Test-NodeB-10318 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #69, conn_id=1) 09:59:02,142 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91452, rsp_expected=true, UNICAST3: DATA, seqno=69, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,142 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,143 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:02,143 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91452, rsp_expected=true, UNICAST3: DATA, seqno=69, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,143 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #69, conn_id=1) 09:59:02,143 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#69 09:59:02,143 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91452 09:59:02,143 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:02,143 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,143 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@718b50a9] 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4d942dac){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4d942dac){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91452 to Test-NodeC-52778 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #69, conn_id=1) 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91452, rsp_expected=true, UNICAST3: DATA, seqno=69, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,143 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38070 09:59:02,147 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,148 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:59:02,165 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91452, rsp_expected=true, UNICAST3: DATA, seqno=69, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,165 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #69, conn_id=1) 09:59:02,167 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#69 09:59:02,171 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,171 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:02,174 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2009f685){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,175 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:59:02,184 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,184 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,187 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:59:02,187 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:59:02,191 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,194 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:38070 09:59:02,194 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38070. 09:59:02,194 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38070}. ACQUIRED => RELEASED 09:59:02,194 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38070}? true 09:59:02,195 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38070} 09:59:02,195 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38070}, null) => true 09:59:02,195 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,199 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,200 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91451 to Test-NodeA-7051 09:59:02,207 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #283, conn_id=0) 09:59:02,208 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91451, rsp_expected=true, UNICAST3: DATA, seqno=283, TP: [cluster_name=ISPN] 09:59:02,210 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,210 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:38070 09:59:02,211 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:02,212 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91451, rsp_expected=true, UNICAST3: DATA, seqno=283, TP: [cluster_name=ISPN] 09:59:02,214 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #283, conn_id=0) 09:59:02,214 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#283 09:59:02,217 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,221 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,223 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,223 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@590e9828] 09:59:02,223 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,223 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:59:02,228 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:02,232 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:59:02,233 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,241 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,241 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:02,241 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,241 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,241 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:02,241 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91462] on Test-NodeC-52778 09:59:02,241 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #281, conn_id=2) 09:59:02,241 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91462, rsp_expected=true, UNICAST3: DATA, seqno=281, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,241 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,241 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:02,241 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91462, rsp_expected=true, UNICAST3: DATA, seqno=281, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,244 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #281, conn_id=2) 09:59:02,246 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#281 09:59:02,247 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91462 09:59:02,250 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:38074. timeout=10000 (MILLISECONDS) 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38074. Timeout=10000 (MILLISECONDS) 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38074} 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38074}. Current=null 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38074}) => true 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38074}. WAITING => ACQUIRED 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38074} successfully acquired the lock. 09:59:02,252 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,252 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,252 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,252 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3bcf6294] 09:59:02,256 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,256 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:59:02,256 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:38074. timeout=10000 (MILLISECONDS) 09:59:02,256 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38074. Timeout=10000 (MILLISECONDS) 09:59:02,256 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38074} 09:59:02,256 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:02,262 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:59:02,263 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,263 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,265 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:59:02,268 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(20b89fbd){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,268 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,269 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,269 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,270 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,272 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:02,273 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91472] on Test-NodeA-7051 09:59:02,273 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #284, conn_id=0) 09:59:02,273 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91472, rsp_expected=true, UNICAST3: DATA, seqno=284, TP: [cluster_name=ISPN] 09:59:02,277 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,278 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:02,281 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91472, rsp_expected=true, UNICAST3: DATA, seqno=284, TP: [cluster_name=ISPN] 09:59:02,281 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #284, conn_id=0) 09:59:02,282 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#284 09:59:02,283 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91472 09:59:02,284 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:02,284 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,284 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,284 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,284 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,293 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@43d3bd47] 09:59:02,295 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,297 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:59:02,309 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,314 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:59:02,323 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,323 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,327 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:59:02,328 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3935c268){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,328 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,330 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,330 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3935c268){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,330 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:59:02,330 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,331 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,344 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:59:02,345 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:59:02,345 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,345 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,348 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91472 to Test-NodeC-52778 09:59:02,348 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #282, conn_id=2) 09:59:02,350 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91472, rsp_expected=true, UNICAST3: DATA, seqno=282, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,350 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38074 09:59:02,350 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,350 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:02,350 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91472, rsp_expected=true, UNICAST3: DATA, seqno=282, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,350 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #282, conn_id=2) 09:59:02,350 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#282 09:59:02,350 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,350 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:02,350 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(20b89fbd){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:38074 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38074. 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38074}. ACQUIRED => RELEASED 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38074}? true 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38074} 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38074}, null) => true 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91462 to Test-NodeA-7051 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #285, conn_id=0) 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91462, rsp_expected=true, UNICAST3: DATA, seqno=285, TP: [cluster_name=ISPN] 09:59:02,351 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:38074 09:59:02,351 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,351 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:02,351 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91462, rsp_expected=true, UNICAST3: DATA, seqno=285, TP: [cluster_name=ISPN] 09:59:02,351 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #285, conn_id=0) 09:59:02,351 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#285 09:59:02,351 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,351 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,351 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,351 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4496b4d3] 09:59:02,351 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,351 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:59:02,351 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:38082. timeout=10000 (MILLISECONDS) 09:59:02,351 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38082. Timeout=10000 (MILLISECONDS) 09:59:02,351 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38082} 09:59:02,351 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38082}. Current=null 09:59:02,351 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38082}) => true 09:59:02,351 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38082}. WAITING => ACQUIRED 09:59:02,351 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38082} successfully acquired the lock. 09:59:02,351 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:59:02,351 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:59:02,351 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,351 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,351 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:59:02,351 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(26fafdd1){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,352 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,352 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,352 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:59:02,352 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,352 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,352 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:02,352 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91489] on Test-NodeB-10318 09:59:02,352 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #159, conn_id=1) 09:59:02,352 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91489, rsp_expected=true, UNICAST3: DATA, seqno=159, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,352 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,352 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:02,352 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91489, rsp_expected=true, UNICAST3: DATA, seqno=159, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,352 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #159, conn_id=1) 09:59:02,352 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#159 09:59:02,352 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91489 09:59:02,352 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,352 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,352 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6b3662d8] 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5daee78d){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5daee78d){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91489 to Test-NodeA-7051 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #161, conn_id=0) 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91489, rsp_expected=true, UNICAST3: DATA, seqno=161, TP: [cluster_name=ISPN] 09:59:02,352 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38082 09:59:02,352 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,353 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:02,353 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91489, rsp_expected=true, UNICAST3: DATA, seqno=161, TP: [cluster_name=ISPN] 09:59:02,353 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #161, conn_id=0) 09:59:02,353 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#161 09:59:02,353 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,353 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:02,353 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(26fafdd1){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,353 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:59:02,353 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,353 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,353 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:59:02,353 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:59:02,353 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,353 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:38082 09:59:02,353 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38082. 09:59:02,353 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38082}. ACQUIRED => RELEASED 09:59:02,353 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38082}? true 09:59:02,353 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38082} 09:59:02,353 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38082}, null) => true 09:59:02,353 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,353 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@27af17f5] 09:59:02,353 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,353 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:59:02,353 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:02,353 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:59:02,353 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,353 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,353 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:02,353 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,353 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,353 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:02,353 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91490] on Test-NodeC-52778 09:59:02,353 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #283, conn_id=2) 09:59:02,353 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91490, rsp_expected=true, UNICAST3: DATA, seqno=283, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,353 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,353 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:02,354 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91490, rsp_expected=true, UNICAST3: DATA, seqno=283, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,362 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #283, conn_id=2) 09:59:02,362 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#283 09:59:02,362 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91490 09:59:02,364 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,365 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,366 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:38083. timeout=10000 (MILLISECONDS) 09:59:02,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38083. Timeout=10000 (MILLISECONDS) 09:59:02,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38083} 09:59:02,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38083}. Current=null 09:59:02,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38083}) => true 09:59:02,368 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38083}. WAITING => ACQUIRED 09:59:02,370 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38083} successfully acquired the lock. 09:59:02,370 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,370 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,377 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7d57957a] 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:38083. timeout=10000 (MILLISECONDS) 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38083. Timeout=10000 (MILLISECONDS) 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38083} 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:59:02,378 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,425 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #161) 09:59:02,425 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=161, ts=105, TP: [cluster_name=ISPN] 09:59:02,424 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #159) 09:59:02,421 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #69) 09:59:02,430 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=69, conn_id=1, ts=93, TP: [cluster_name=ISPN] 09:59:02,385 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,430 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:59:02,431 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2b0bb897){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,430 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,430 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #283) 09:59:02,432 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=283, conn_id=2, ts=94, TP: [cluster_name=ISPN] 09:59:02,432 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=159, conn_id=1, ts=90, TP: [cluster_name=ISPN] 09:59:02,433 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #69) 09:59:02,433 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=69, conn_id=1, ts=91, TP: [cluster_name=ISPN] 09:59:02,433 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:59:02,433 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:02,433 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:02,428 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,428 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #285) 09:59:02,436 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=285, ts=106, TP: [cluster_name=ISPN] 09:59:02,433 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=69, conn_id=1, ts=91, TP: [cluster_name=ISPN] 09:59:02,433 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:02,433 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=159, conn_id=1, ts=90, TP: [cluster_name=ISPN] 09:59:02,432 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:02,443 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,443 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:02,431 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,443 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=69, conn_id=1, ts=93, TP: [cluster_name=ISPN] 09:59:02,443 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #69, conn-id=1, ts=93) 09:59:02,442 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #159, conn-id=1, ts=90) 09:59:02,441 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=161, ts=105, TP: [cluster_name=ISPN] 09:59:02,441 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,444 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:02,441 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #69, conn-id=1, ts=91) 09:59:02,445 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=285, ts=106, TP: [cluster_name=ISPN] 09:59:02,445 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #285, conn-id=0, ts=106) 09:59:02,444 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #161, conn-id=0, ts=105) 09:59:02,444 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=283, conn_id=2, ts=94, TP: [cluster_name=ISPN] 09:59:02,444 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,449 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,451 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #283, conn-id=2, ts=94) 09:59:02,450 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,460 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:02,460 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91504] on Test-NodeA-7051 09:59:02,460 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #286, conn_id=0) 09:59:02,460 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91504, rsp_expected=true, UNICAST3: DATA, seqno=286, TP: [cluster_name=ISPN] 09:59:02,462 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,462 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:02,465 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91504, rsp_expected=true, UNICAST3: DATA, seqno=286, TP: [cluster_name=ISPN] 09:59:02,465 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #286, conn_id=0) 09:59:02,465 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#286 09:59:02,465 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91504 09:59:02,467 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:02,473 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,473 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@30a224c7] 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2f158ce6){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2f158ce6){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91504 to Test-NodeC-52778 09:59:02,473 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #284, conn_id=2) 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91504, rsp_expected=true, UNICAST3: DATA, seqno=284, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,475 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:02,475 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38083 09:59:02,477 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91504, rsp_expected=true, UNICAST3: DATA, seqno=284, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,477 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #284, conn_id=2) 09:59:02,478 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#284 09:59:02,478 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,479 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:02,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2b0bb897){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,489 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:38083 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38083. 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38083}. ACQUIRED => RELEASED 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38083}? true 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38083} 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38083}, null) => true 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91490 to Test-NodeA-7051 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #287, conn_id=0) 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91490, rsp_expected=true, UNICAST3: DATA, seqno=287, TP: [cluster_name=ISPN] 09:59:02,490 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:38083 09:59:02,490 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,490 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:02,499 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91490, rsp_expected=true, UNICAST3: DATA, seqno=287, TP: [cluster_name=ISPN] 09:59:02,501 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #287, conn_id=0) 09:59:02,508 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#287 09:59:02,508 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,508 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,508 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,509 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3c95f2a2] 09:59:02,509 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,515 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:59:02,530 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:02,536 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:59:02,541 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,542 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,544 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:02,556 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,556 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,556 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:02,557 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91520] on Test-NodeC-52778 09:59:02,557 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #285, conn_id=2) 09:59:02,557 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91520, rsp_expected=true, UNICAST3: DATA, seqno=285, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,557 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,557 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91520, rsp_expected=true, UNICAST3: DATA, seqno=285, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #285, conn_id=2) 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#285 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91520 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:38088. timeout=10000 (MILLISECONDS) 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38088. Timeout=10000 (MILLISECONDS) 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38088} 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38088}. Current=null 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38088}) => true 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38088}. WAITING => ACQUIRED 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38088} successfully acquired the lock. 09:59:02,557 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4329b347] 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:38088. timeout=10000 (MILLISECONDS) 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38088. Timeout=10000 (MILLISECONDS) 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38088} 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,557 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(52f1d3a8){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91521] on Test-NodeA-7051 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #288, conn_id=0) 09:59:02,558 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91521, rsp_expected=true, UNICAST3: DATA, seqno=288, TP: [cluster_name=ISPN] 09:59:02,558 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,558 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:02,558 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91521, rsp_expected=true, UNICAST3: DATA, seqno=288, TP: [cluster_name=ISPN] 09:59:02,558 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #288, conn_id=0) 09:59:02,558 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#288 09:59:02,559 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91521 09:59:02,559 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:02,559 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,559 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@71f225c6] 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(66438f12){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(66438f12){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91521 to Test-NodeC-52778 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #286, conn_id=2) 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91521, rsp_expected=true, UNICAST3: DATA, seqno=286, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38088 09:59:02,559 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,559 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:02,560 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91521, rsp_expected=true, UNICAST3: DATA, seqno=286, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,562 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #286, conn_id=2) 09:59:02,562 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#286 09:59:02,562 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,562 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:02,562 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(52f1d3a8){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,562 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:59:02,567 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,570 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,574 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:59:02,575 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:59:02,577 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,577 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:38088 09:59:02,577 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38088. 09:59:02,580 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38088}. ACQUIRED => RELEASED 09:59:02,590 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38088}? true 09:59:02,595 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38088} 09:59:02,598 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38088}, null) => true 09:59:02,598 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,599 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,599 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91520 to Test-NodeA-7051 09:59:02,599 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #289, conn_id=0) 09:59:02,599 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91520, rsp_expected=true, UNICAST3: DATA, seqno=289, TP: [cluster_name=ISPN] 09:59:02,605 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:38088 09:59:02,605 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,615 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:02,615 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91520, rsp_expected=true, UNICAST3: DATA, seqno=289, TP: [cluster_name=ISPN] 09:59:02,617 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #289, conn_id=0) 09:59:02,617 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#289 09:59:02,624 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,624 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,629 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,629 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3ced9fc9] 09:59:02,629 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,629 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:59:02,629 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:02,629 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:59:02,629 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,631 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,647 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:02,647 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,647 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,647 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:02,647 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91535] on Test-NodeB-10318 09:59:02,647 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #160, conn_id=1) 09:59:02,647 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91535, rsp_expected=true, UNICAST3: DATA, seqno=160, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,647 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,648 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:02,652 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91535, rsp_expected=true, UNICAST3: DATA, seqno=160, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,652 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #160, conn_id=1) 09:59:02,656 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#160 09:59:02,656 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91535 09:59:02,656 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,658 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,658 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:38094. timeout=10000 (MILLISECONDS) 09:59:02,659 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38094. Timeout=10000 (MILLISECONDS) 09:59:02,659 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38094} 09:59:02,659 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38094}. Current=null 09:59:02,659 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38094}) => true 09:59:02,659 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38094}. WAITING => ACQUIRED 09:59:02,660 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38094} successfully acquired the lock. 09:59:02,660 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,660 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,661 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,662 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@768bea89] 09:59:02,662 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,663 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:59:02,663 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:38094. timeout=10000 (MILLISECONDS) 09:59:02,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38094. Timeout=10000 (MILLISECONDS) 09:59:02,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38094} 09:59:02,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:02,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:59:02,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1a1e40b9){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91545] on Test-NodeC-52778 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #70, conn_id=1) 09:59:02,685 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91545, rsp_expected=true, UNICAST3: DATA, seqno=70, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,686 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,686 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:59:02,690 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91545, rsp_expected=true, UNICAST3: DATA, seqno=70, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,690 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #70, conn_id=1) 09:59:02,690 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#70 09:59:02,690 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91545 09:59:02,690 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:02,690 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,690 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,690 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,697 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,697 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@925a5f8] 09:59:02,701 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,701 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:59:02,701 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,701 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:59:02,701 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,701 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,701 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:59:02,701 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2fe587b0){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2fe587b0){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91545 to Test-NodeB-10318 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #70, conn_id=1) 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91545, rsp_expected=true, UNICAST3: DATA, seqno=70, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,702 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38094 09:59:02,702 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,702 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:02,711 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91545, rsp_expected=true, UNICAST3: DATA, seqno=70, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,711 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #70, conn_id=1) 09:59:02,711 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#70 09:59:02,722 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,722 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,722 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1a1e40b9){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,722 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:59:02,722 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:38094 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38094. 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38094}. ACQUIRED => RELEASED 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38094}? true 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38094} 09:59:02,723 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38094}, null) => true 09:59:02,724 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,724 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,724 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91535 to Test-NodeA-7051 09:59:02,724 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #162, conn_id=0) 09:59:02,724 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91535, rsp_expected=true, UNICAST3: DATA, seqno=162, TP: [cluster_name=ISPN] 09:59:02,724 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:38094 09:59:02,724 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,724 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:02,731 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91535, rsp_expected=true, UNICAST3: DATA, seqno=162, TP: [cluster_name=ISPN] 09:59:02,746 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #162, conn_id=0) 09:59:02,752 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#162 09:59:02,752 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,752 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:02,753 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,753 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@10552e7a] 09:59:02,770 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,778 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:59:02,778 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:02,778 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:59:02,778 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,778 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,778 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:02,785 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,785 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,785 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:02,785 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91557] on Test-NodeC-52778 09:59:02,785 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #287, conn_id=2) 09:59:02,785 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91557, rsp_expected=true, UNICAST3: DATA, seqno=287, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,785 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,785 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:02,788 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91557, rsp_expected=true, UNICAST3: DATA, seqno=287, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,788 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #287, conn_id=2) 09:59:02,788 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#287 09:59:02,788 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91557 09:59:02,788 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,802 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,802 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:38100. timeout=10000 (MILLISECONDS) 09:59:02,802 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38100. Timeout=10000 (MILLISECONDS) 09:59:02,810 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38100} 09:59:02,810 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38100}. Current=null 09:59:02,810 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38100}) => true 09:59:02,812 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38100}. WAITING => ACQUIRED 09:59:02,812 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38100} successfully acquired the lock. 09:59:02,816 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,816 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,816 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@52ed16fe] 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:38100. timeout=10000 (MILLISECONDS) 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38100. Timeout=10000 (MILLISECONDS) 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38100} 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7077be80){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,833 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,839 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,839 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,842 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:02,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91563] on Test-NodeA-7051 09:59:02,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #290, conn_id=0) 09:59:02,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91563, rsp_expected=true, UNICAST3: DATA, seqno=290, TP: [cluster_name=ISPN] 09:59:02,844 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,844 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:02,847 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91563, rsp_expected=true, UNICAST3: DATA, seqno=290, TP: [cluster_name=ISPN] 09:59:02,850 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #290, conn_id=0) 09:59:02,850 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#290 09:59:02,850 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91563 09:59:02,850 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:02,850 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,850 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@47e60b01] 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:59:02,850 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4497dda7){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4497dda7){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91563 to Test-NodeC-52778 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #288, conn_id=2) 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91563, rsp_expected=true, UNICAST3: DATA, seqno=288, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,851 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38100 09:59:02,851 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,851 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:02,851 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91563, rsp_expected=true, UNICAST3: DATA, seqno=288, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,851 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #288, conn_id=2) 09:59:02,851 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#288 09:59:02,851 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,851 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:02,854 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7077be80){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,854 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:59:02,854 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,854 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,854 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:59:02,854 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:59:02,855 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,855 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:38100 09:59:02,861 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38100. 09:59:02,862 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38100}. ACQUIRED => RELEASED 09:59:02,862 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38100}? true 09:59:02,868 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38100} 09:59:02,868 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38100}, null) => true 09:59:02,868 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,885 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,885 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91557 to Test-NodeA-7051 09:59:02,885 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #291, conn_id=0) 09:59:02,885 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91557, rsp_expected=true, UNICAST3: DATA, seqno=291, TP: [cluster_name=ISPN] 09:59:02,885 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,885 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:02,885 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:38100 09:59:02,885 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91557, rsp_expected=true, UNICAST3: DATA, seqno=291, TP: [cluster_name=ISPN] 09:59:02,890 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #291, conn_id=0) 09:59:02,890 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#291 09:59:02,890 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,890 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,890 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,900 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:59:02,900 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:59:02,901 DEBUG (testng-Test:[]) [Test] Found key key-to-change1 with primary owner != Test-NodeA-7051, segment 184 09:59:02,901 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5a501db3] 09:59:02,901 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:02,901 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:59:02,901 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:02,901 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:59:02,901 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,901 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,901 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:02,901 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,901 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,901 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:02,901 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91569] on Test-NodeB-10318 09:59:02,901 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #161, conn_id=1) 09:59:02,901 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91569, rsp_expected=true, UNICAST3: DATA, seqno=161, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,901 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,901 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:59:02,902 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91569, rsp_expected=true, UNICAST3: DATA, seqno=161, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,902 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #161, conn_id=1) 09:59:02,902 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#161 09:59:02,902 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91569 09:59:02,902 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:38107. timeout=10000 (MILLISECONDS) 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38107. Timeout=10000 (MILLISECONDS) 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38107} 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38107}. Current=null 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38107}) => true 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38107}. WAITING => ACQUIRED 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38107} successfully acquired the lock. 09:59:02,903 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@432346d2] 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:38107. timeout=10000 (MILLISECONDS) 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38107. Timeout=10000 (MILLISECONDS) 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38107} 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(47a8158c){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91570] on Test-NodeA-7051 09:59:02,903 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #163, conn_id=0) 09:59:02,904 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91570, rsp_expected=true, UNICAST3: DATA, seqno=163, TP: [cluster_name=ISPN] 09:59:02,906 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,906 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (210 bytes) 09:59:02,907 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91570, rsp_expected=true, UNICAST3: DATA, seqno=163, TP: [cluster_name=ISPN] 09:59:02,907 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #163, conn_id=0) 09:59:02,907 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#163 09:59:02,907 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91570 09:59:02,908 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:02,908 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:02,908 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@24ab0ce6] 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5e6a2c7e){key=key-to-change1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5e6a2c7e){key=key-to-change1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=initial-value} in container 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91570 to Test-NodeB-10318 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #162, conn_id=1) 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91570, rsp_expected=true, UNICAST3: DATA, seqno=162, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,911 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38107 09:59:02,912 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,912 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:02,913 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91570, rsp_expected=true, UNICAST3: DATA, seqno=162, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,913 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #162, conn_id=1) 09:59:02,913 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#162 09:59:02,913 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,915 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:02,915 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(47a8158c){key=key-to-change1, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:02,915 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:59:02,915 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:02,915 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:02,915 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:59:02,915 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change1, value=initial-value} in container 09:59:02,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:38107 09:59:02,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38107. 09:59:02,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38107}. ACQUIRED => RELEASED 09:59:02,927 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38107}? true 09:59:02,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38107} 09:59:02,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38107}, null) => true 09:59:02,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:02,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:02,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91569 to Test-NodeA-7051 09:59:02,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #164, conn_id=0) 09:59:02,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91569, rsp_expected=true, UNICAST3: DATA, seqno=164, TP: [cluster_name=ISPN] 09:59:02,928 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:38107 09:59:02,928 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,928 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:02,932 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #70) 09:59:02,932 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=70, conn_id=1, ts=95, TP: [cluster_name=ISPN] 09:59:02,932 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #288) 09:59:02,932 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=288, conn_id=2, ts=96, TP: [cluster_name=ISPN] 09:59:02,937 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #162) 09:59:02,937 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=162, conn_id=1, ts=92, TP: [cluster_name=ISPN] 09:59:02,937 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #70) 09:59:02,937 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=70, conn_id=1, ts=93, TP: [cluster_name=ISPN] 09:59:02,937 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:59:02,937 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:02,937 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:02,938 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=162, conn_id=1, ts=92, TP: [cluster_name=ISPN] 09:59:02,938 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #162, conn-id=1, ts=92) 09:59:02,938 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=70, conn_id=1, ts=93, TP: [cluster_name=ISPN] 09:59:02,938 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #70, conn-id=1, ts=93) 09:59:02,928 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91569, rsp_expected=true, UNICAST3: DATA, seqno=164, TP: [cluster_name=ISPN] 09:59:02,939 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #164, conn_id=0) 09:59:02,939 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#164 09:59:02,939 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,939 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change1, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:02,940 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:02,940 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_invoked * 1 09:59:02,940 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:59:02,940 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 0f6ad974-877a-4ec6-8ce2-7df26f6a8e1f 09:59:02,941 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@43a9123c[Not completed] to remote execution at node Test-NodeB-10318 09:59:02,941 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4863947a] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,941 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4863947a], mode=SYNCHRONOUS, timeout=15000 09:59:02,941 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4863947a] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:02,932 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,944 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:02,950 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,950 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:02,950 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=288, conn_id=2, ts=96, TP: [cluster_name=ISPN] 09:59:02,950 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #288, conn-id=2, ts=96) 09:59:02,941 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #164) 09:59:02,950 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91578] on Test-NodeB-10318 09:59:02,951 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #163, conn_id=1) 09:59:02,951 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91578, rsp_expected=true, UNICAST3: DATA, seqno=163, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,951 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:02,951 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@2406c00[Not completed] to remote execution at node Test-NodeC-52778 09:59:02,951 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4863947a] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:02,951 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4863947a], mode=SYNCHRONOUS, timeout=15000 09:59:02,951 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4863947a] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:02,951 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91579] on Test-NodeC-52778 09:59:02,951 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #289, conn_id=2) 09:59:02,951 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91579, rsp_expected=true, UNICAST3: DATA, seqno=289, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,952 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=70, conn_id=1, ts=95, TP: [cluster_name=ISPN] 09:59:02,952 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #70, conn-id=1, ts=95) 09:59:02,951 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:59:02,955 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (237 bytes (1185.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:02,955 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (240 bytes) 09:59:02,959 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91578, rsp_expected=true, UNICAST3: DATA, seqno=163, conn_id=1, TP: [cluster_name=ISPN] 09:59:02,959 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #163, conn_id=1) 09:59:02,959 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#163 09:59:02,959 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91578 09:59:02,959 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4f8ebef3] [sender=Test-NodeA-7051] 09:59:02,959 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:02,959 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,959 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4f8ebef3] 09:59:02,959 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91579, rsp_expected=true, UNICAST3: DATA, seqno=289, conn_id=2, TP: [cluster_name=ISPN] 09:59:02,959 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #289, conn_id=2) 09:59:02,959 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#289 09:59:02,959 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91579 09:59:02,959 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 0f6ad974-877a-4ec6-8ce2-7df26f6a8e1f 09:59:02,959 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2a3c64f1] [sender=Test-NodeA-7051] 09:59:02,959 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:02,959 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:02,959 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2a3c64f1] 09:59:02,960 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 0f6ad974-877a-4ec6-8ce2-7df26f6a8e1f 09:59:02,960 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@2a3c64f1] 09:59:02,960 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91579 to Test-NodeA-7051 09:59:02,960 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #292, conn_id=0) 09:59:02,960 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91579, rsp_expected=true, UNICAST3: DATA, seqno=292, TP: [cluster_name=ISPN] 09:59:02,950 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=164, ts=107, TP: [cluster_name=ISPN] 09:59:02,960 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,960 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #291) 09:59:02,960 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=291, ts=108, TP: [cluster_name=ISPN] 09:59:02,960 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (121 bytes (605.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:59:02,960 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:02,960 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:02,960 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=291, ts=108, TP: [cluster_name=ISPN] 09:59:02,960 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #291, conn-id=0, ts=108) 09:59:02,972 TRACE (Timer-3,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:02,972 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:02,972 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,972 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:59:02,960 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=164, ts=107, TP: [cluster_name=ISPN] 09:59:02,980 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #164, conn-id=0, ts=107) 09:59:02,960 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:02,959 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4f8ebef3] 09:59:02,982 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91578 to Test-NodeA-7051 09:59:02,982 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91579, rsp_expected=true, UNICAST3: DATA, seqno=292, TP: [cluster_name=ISPN] 09:59:02,982 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #292, conn_id=0) 09:59:02,982 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#292 09:59:02,982 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,982 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4863947a] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:02,982 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #165, conn_id=0) 09:59:02,983 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91578, rsp_expected=true, UNICAST3: DATA, seqno=165, TP: [cluster_name=ISPN] 09:59:02,983 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:02,983 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:02,972 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:02,984 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeB-10318: mine: Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:02,983 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91578, rsp_expected=true, UNICAST3: DATA, seqno=165, TP: [cluster_name=ISPN] 09:59:02,992 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #165, conn_id=0) 09:59:02,992 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#165 09:59:02,992 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:02,993 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4863947a] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:02,993 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 0f6ad974-877a-4ec6-8ce2-7df26f6a8e1f requests initial state for cache 09:59:02,994 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@94c6c7b] 09:59:02,994 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:02,995 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_invoked * 1 (available = 1, total = 1) 09:59:03,003 TRACE (testng-Test:[]) [CheckPoint] Received event pre_retrieve_entry_invoked * 1 (available = 0, total = 1) 09:59:03,003 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_released * 1 09:59:03,007 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@65a93d9a] 09:59:03,007 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id -1 09:59:03,007 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:59:03,007 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:03,007 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? false 09:59:03,007 TRACE (testng-Test:[]) [CallInterceptor] Invoking: RemoveCommand 09:59:03,024 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,025 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:03,034 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,035 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:59:03,042 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:03,062 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91587] on Test-NodeB-10318 09:59:03,062 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #164, conn_id=1) 09:59:03,062 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91587, rsp_expected=true, UNICAST3: DATA, seqno=164, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,062 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (172 bytes (860.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,062 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (175 bytes) 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=98 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91587, rsp_expected=true, UNICAST3: DATA, seqno=164, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #164, conn_id=1) 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#164 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91587 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeA-7051] 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:38112. timeout=10000 (MILLISECONDS) 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38112. Timeout=10000 (MILLISECONDS) 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38112} 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38112}. Current=null 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38112}) => true 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38112}. WAITING => ACQUIRED 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38112} successfully acquired the lock. 09:59:03,064 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,064 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:59:03,064 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:59:03,064 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2b77dab5] 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change1'? true 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-to-change1 for owner=CommandInvocation:Test-NodeA-7051:38112. timeout=10000 (MILLISECONDS) 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38112. Timeout=10000 (MILLISECONDS) 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38112} 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(72b86ab6){key=key-to-change1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: RemoveCommand 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeB-10318, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91588] on Test-NodeA-7051 09:59:03,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #166, conn_id=0) 09:59:03,070 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91588, rsp_expected=true, UNICAST3: DATA, seqno=166, TP: [cluster_name=ISPN] 09:59:03,070 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (172 bytes (860.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,074 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (175 bytes) 09:59:03,077 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=98 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91588, rsp_expected=true, UNICAST3: DATA, seqno=166, TP: [cluster_name=ISPN] 09:59:03,077 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #166, conn_id=0) 09:59:03,077 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#166 09:59:03,077 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91588 09:59:03,077 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeB-10318] 09:59:03,077 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:03,077 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:59:03,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:59:03,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@29238ab1] 09:59:03,082 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:59:03,082 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change1'? false 09:59:03,083 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:03,083 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change1'? true 09:59:03,086 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:03,086 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change1, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:59:03,086 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change1 09:59:03,086 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(532310d7){key=key-to-change1, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: RemoveCommand 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(532310d7){key=key-to-change1, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91588 to Test-NodeB-10318 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #165, conn_id=1) 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91588, rsp_expected=true, UNICAST3: DATA, seqno=165, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,099 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38112 09:59:03,099 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,099 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (96 bytes) 09:59:03,099 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91588, rsp_expected=true, UNICAST3: DATA, seqno=165, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,099 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #165, conn_id=1) 09:59:03,099 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#165 09:59:03,100 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:59:03,100 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeA-7051=SuccessfulResponse{responseValue=initial-value} } 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(72b86ab6){key=key-to-change1, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change1. Operation Flag=null, L1 invalidation=false 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change1 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RemoteClusterListener] Passing Event to manager EventImpl{type=CACHE_ENTRY_REMOVED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, key=key-to-change1, value=null, oldValue=initial-value, transaction=null, originLocal=false, transactionSuccessful=false, entries=null, created=false} to send to Test-NodeA-7051 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@7019ddee[Not completed] to remote execution at node Test-NodeA-7051 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@14fe8b] to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@14fe8b], mode=SYNCHRONOUS, timeout=15000 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@14fe8b] to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91596] on Test-NodeA-7051 09:59:03,100 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #167, conn_id=0) 09:59:03,101 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91596, rsp_expected=true, UNICAST3: DATA, seqno=167, TP: [cluster_name=ISPN] 09:59:03,101 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (361 bytes (1805.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,101 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (364 bytes) 09:59:03,101 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=287 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91596, rsp_expected=true, UNICAST3: DATA, seqno=167, TP: [cluster_name=ISPN] 09:59:03,101 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #167, conn_id=0) 09:59:03,101 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#167 09:59:03,101 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91596 09:59:03,101 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@23710881] [sender=Test-NodeB-10318] 09:59:03,101 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:03,101 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,101 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@23710881] 09:59:03,101 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterEventCallable] Received cluster event(s) [ClusterEvent {type=CACHE_ENTRY_REMOVED, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-to-change1, value=null, oldValue=initial-value, transaction=null, retryCommand=false, origin=Test-NodeB-10318}], notifying cluster listener with id 0f6ad974-877a-4ec6-8ce2-7df26f6a8e1f 09:59:03,101 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@23710881] 09:59:03,102 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91596 to Test-NodeB-10318 09:59:03,102 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #166, conn_id=1) 09:59:03,102 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91596, rsp_expected=true, UNICAST3: DATA, seqno=166, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,102 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,102 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:03,102 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91596, rsp_expected=true, UNICAST3: DATA, seqno=166, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,102 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #166, conn_id=1) 09:59:03,102 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#166 09:59:03,102 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:03,102 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterEventCallable@14fe8b] is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:38112 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38112. 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38112}. ACQUIRED => RELEASED 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38112}? true 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38112} 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38112}, null) => true 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91587 to Test-NodeA-7051 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #168, conn_id=0) 09:59:03,102 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91587, rsp_expected=true, UNICAST3: DATA, seqno=168, TP: [cluster_name=ISPN] 09:59:03,114 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-to-change1]. owner=CommandInvocation:Test-NodeA-7051:38112 09:59:03,115 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,116 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:59:03,132 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91587, rsp_expected=true, UNICAST3: DATA, seqno=168, TP: [cluster_name=ISPN] 09:59:03,163 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #168, conn_id=0) 09:59:03,206 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#168 09:59:03,206 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:59:03,206 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change1, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:59:03,216 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:59:03,216 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_released * 999999999 (available = 999999999, total = 999999999) 09:59:03,216 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_retrieve_entry_released * 1 (available = 999999998, total = 999999999) 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705116 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705116 excluding keys [] 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91608] on Test-NodeB-10318 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #167, conn_id=1) 09:59:03,217 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91608, rsp_expected=true, UNICAST3: DATA, seqno=167, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,217 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,218 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:59:03,218 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91608, rsp_expected=true, UNICAST3: DATA, seqno=167, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,218 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #167, conn_id=1) 09:59:03,218 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#167 09:59:03,218 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91608 09:59:03,218 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:59:03,218 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:03,218 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:03,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705116 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:03,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@2848b0b1] 09:59:03,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:03,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705116 09:59:03,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705116 09:59:03,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705116 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705116 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705116 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91609] on Test-NodeA-7051 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #169, conn_id=0) 09:59:03,219 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91609, rsp_expected=true, UNICAST3: DATA, seqno=169, TP: [cluster_name=ISPN] 09:59:03,219 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (225 bytes (1125.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,225 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (228 bytes) 09:59:03,231 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=151 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91609, rsp_expected=true, UNICAST3: DATA, seqno=169, TP: [cluster_name=ISPN] 09:59:03,231 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #169, conn_id=0) 09:59:03,231 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#169 09:59:03,231 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91609 09:59:03,231 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:59:03,231 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:03,232 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,232 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:03,245 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705116 with [] suspected segments. 09:59:03,259 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:03,263 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:59:03,281 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:03,281 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91609 to Test-NodeB-10318 09:59:03,283 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #168, conn_id=1) 09:59:03,285 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91609, rsp_expected=true, UNICAST3: DATA, seqno=168, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,287 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,287 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:59:03,287 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91609, rsp_expected=true, UNICAST3: DATA, seqno=168, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,296 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #168, conn_id=1) 09:59:03,309 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#168 09:59:03,315 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:59:03,317 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,317 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:59:03,317 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:59:03,317 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:59:03,317 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:59:03,317 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:59:03,315 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:03,317 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:03,317 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91608 to Test-NodeA-7051 09:59:03,320 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #170, conn_id=0) 09:59:03,320 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91608, rsp_expected=true, UNICAST3: DATA, seqno=170, TP: [cluster_name=ISPN] 09:59:03,320 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,320 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:59:03,320 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91608, rsp_expected=true, UNICAST3: DATA, seqno=170, TP: [cluster_name=ISPN] 09:59:03,320 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #170, conn_id=0) 09:59:03,320 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#170 09:59:03,320 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:59:03,320 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:03,317 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:59:03,323 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:59:03,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:59:03,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:59:03,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:59:03,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:59:03,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:59:03,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:59:03,321 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705116 excluding keys [] 09:59:03,330 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,330 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:59:03,332 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:03,332 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:03,332 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91627] on Test-NodeC-52778 09:59:03,332 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #290, conn_id=2) 09:59:03,332 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91627, rsp_expected=true, UNICAST3: DATA, seqno=290, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,332 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (608 bytes (3040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:59:03,332 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:59:03,334 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:59:03,334 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:59:03,332 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (611 bytes) 09:59:03,334 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91627, rsp_expected=true, UNICAST3: DATA, seqno=290, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,334 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:59:03,336 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:59:03,336 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:59:03,335 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #290, conn_id=2) 09:59:03,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:59:03,339 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#290 09:59:03,347 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91627 09:59:03,348 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:59:03,348 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:03,348 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,348 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:03,348 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705116 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:03,348 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7d03488b] 09:59:03,348 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:03,348 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705116 09:59:03,348 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705116 09:59:03,348 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705116 09:59:03,348 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:03,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Request Test-NodeA-705116 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:59:03,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705116 09:59:03,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:03,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:03,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91628] on Test-NodeA-7051 09:59:03,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #293, conn_id=0) 09:59:03,349 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91628, rsp_expected=true, UNICAST3: DATA, seqno=293, TP: [cluster_name=ISPN] 09:59:03,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:59:03,364 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (316 bytes (1580.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,367 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (319 bytes) 09:59:03,366 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:59:03,374 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:59:03,376 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=241 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91628, rsp_expected=true, UNICAST3: DATA, seqno=293, TP: [cluster_name=ISPN] 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:59:03,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:59:03,378 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,378 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:59:03,378 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:59:03,376 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #293, conn_id=0) 09:59:03,385 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#293 09:59:03,385 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91628 09:59:03,386 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:59:03,386 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:03,386 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705116 with [] suspected segments. 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705116 as completed! 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91628 to Test-NodeC-52778 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #291, conn_id=2) 09:59:03,386 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91628, rsp_expected=true, UNICAST3: DATA, seqno=291, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,387 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,387 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (80 bytes) 09:59:03,388 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91628, rsp_expected=true, UNICAST3: DATA, seqno=291, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,388 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #291, conn_id=2) 09:59:03,388 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#291 09:59:03,388 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:59:03,388 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:03,445 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #291) 09:59:03,445 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=291, conn_id=2, ts=97, TP: [cluster_name=ISPN] 09:59:03,445 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #168) 09:59:03,447 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=168, conn_id=1, ts=94, TP: [cluster_name=ISPN] 09:59:03,447 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,447 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:03,447 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=168, conn_id=1, ts=94, TP: [cluster_name=ISPN] 09:59:03,388 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:03,450 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91627 to Test-NodeA-7051 09:59:03,450 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #294, conn_id=0) 09:59:03,450 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91627, rsp_expected=true, UNICAST3: DATA, seqno=294, TP: [cluster_name=ISPN] 09:59:03,447 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #168, conn-id=1, ts=94) 09:59:03,450 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,461 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (80 bytes) 09:59:03,462 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,462 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:03,463 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #170) 09:59:03,463 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=170, ts=109, TP: [cluster_name=ISPN] 09:59:03,463 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #293) 09:59:03,463 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,463 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=293, ts=110, TP: [cluster_name=ISPN] 09:59:03,465 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91627, rsp_expected=true, UNICAST3: DATA, seqno=294, TP: [cluster_name=ISPN] 09:59:03,465 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #294, conn_id=0) 09:59:03,465 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=291, conn_id=2, ts=97, TP: [cluster_name=ISPN] 09:59:03,465 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #291, conn-id=2, ts=97) 09:59:03,478 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,478 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 129 09:59:03,494 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 130 09:59:03,494 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 131 09:59:03,494 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 4 09:59:03,494 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 132 09:59:03,494 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 133 09:59:03,465 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#294 09:59:03,496 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:59:03,463 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:03,499 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,499 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:03,499 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=170, ts=109, TP: [cluster_name=ISPN] 09:59:03,499 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #170, conn-id=0, ts=109) 09:59:03,499 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=293, ts=110, TP: [cluster_name=ISPN] 09:59:03,494 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 135 09:59:03,514 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 8 09:59:03,522 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 10 09:59:03,504 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:03,526 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:03,526 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-705116 09:59:03,527 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:03,527 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:59:03,527 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705116 09:59:03,527 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705116 being completed: true 09:59:03,527 TRACE (async-thread-Test-NodeA-p23741-t1:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705116 09:59:03,499 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #293, conn-id=0, ts=110) 09:59:03,522 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 139 09:59:03,531 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 14 09:59:03,532 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 15 09:59:03,532 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 16 09:59:03,532 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 18 09:59:03,532 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 19 09:59:03,532 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 147 09:59:03,532 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 148 09:59:03,534 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 21 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 151 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 153 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 30 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 158 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 31 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 159 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 164 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 40 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 41 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 45 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 47 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 180 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 181 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 60 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 63 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 67 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 195 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 69 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 201 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 74 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 203 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 76 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 205 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 78 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 81 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 82 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 210 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 83 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 85 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 86 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 90 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 219 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 93 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 94 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 222 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 96 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 224 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 98 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 99 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 227 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 228 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 103 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 107 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 108 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 236 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 239 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 240 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 113 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 241 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 245 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 119 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 120 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 249 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 122 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 124 09:59:03,538 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 253 09:59:03,538 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,538 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,550 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,551 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,551 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,551 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,551 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:59:03,551 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:59:03,551 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:59:03,551 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:59:03,551 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:59:03,551 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:59:03,551 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:59:03,551 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:03,551 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:59:03,551 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 0f6ad974-877a-4ec6-8ce2-7df26f6a8e1f initial state for cache completed 09:59:03,551 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:59:03,552 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@3a72e9e9[Not completed] to self 09:59:03,560 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@6a07dc82[Not completed] to remote execution at node Test-NodeB-10318 09:59:03,566 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@bf0bb3c] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,566 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@bf0bb3c], mode=SYNCHRONOUS, timeout=15000 09:59:03,566 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@bf0bb3c] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:03,566 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91656] on Test-NodeB-10318 09:59:03,566 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #169, conn_id=1) 09:59:03,566 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91656, rsp_expected=true, UNICAST3: DATA, seqno=169, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,566 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,566 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:59:03,566 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@3f121151[Not completed] to remote execution at node Test-NodeC-52778 09:59:03,566 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@bf0bb3c] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,566 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@bf0bb3c], mode=SYNCHRONOUS, timeout=15000 09:59:03,566 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@bf0bb3c] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:03,566 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91657] on Test-NodeC-52778 09:59:03,566 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #292, conn_id=2) 09:59:03,566 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91657, rsp_expected=true, UNICAST3: DATA, seqno=292, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,569 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91656, rsp_expected=true, UNICAST3: DATA, seqno=169, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,569 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #169, conn_id=1) 09:59:03,570 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#169 09:59:03,570 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91656 09:59:03,570 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28476885] [sender=Test-NodeA-7051] 09:59:03,570 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:03,570 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,570 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28476885] 09:59:03,570 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 0f6ad974-877a-4ec6-8ce2-7df26f6a8e1f 09:59:03,566 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (213 bytes (1065.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,581 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (216 bytes) 09:59:03,583 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91657, rsp_expected=true, UNICAST3: DATA, seqno=292, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,570 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@28476885] 09:59:03,597 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91656 to Test-NodeA-7051 09:59:03,598 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #171, conn_id=0) 09:59:03,598 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91656, rsp_expected=true, UNICAST3: DATA, seqno=171, TP: [cluster_name=ISPN] 09:59:03,598 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,598 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:03,599 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91656, rsp_expected=true, UNICAST3: DATA, seqno=171, TP: [cluster_name=ISPN] 09:59:03,599 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #171, conn_id=0) 09:59:03,599 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#171 09:59:03,599 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:03,599 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@bf0bb3c] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:03,583 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #292, conn_id=2) 09:59:03,606 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#292 09:59:03,607 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91657 09:59:03,607 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f564754] [sender=Test-NodeA-7051] 09:59:03,608 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:03,613 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f564754] 09:59:03,613 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,614 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 0f6ad974-877a-4ec6-8ce2-7df26f6a8e1f 09:59:03,614 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f564754] 09:59:03,614 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91657 to Test-NodeA-7051 09:59:03,614 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #295, conn_id=0) 09:59:03,626 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91657, rsp_expected=true, UNICAST3: DATA, seqno=295, TP: [cluster_name=ISPN] 09:59:03,626 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,626 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:03,628 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91657, rsp_expected=true, UNICAST3: DATA, seqno=295, TP: [cluster_name=ISPN] 09:59:03,629 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #295, conn_id=0) 09:59:03,679 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#295 09:59:03,679 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:03,679 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@bf0bb3c] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:03,679 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:59:03,679 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:59:03,680 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganButNotIteratedValueYetNonOwnerClustered 09:59:03,680 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:59:03,680 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:59:03,687 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:59:03,689 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:59:03,689 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:03,690 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:59:03,692 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:59:03,701 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:03,704 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:59:03,705 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:59:03,709 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:03,709 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:59:03,710 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:59:03,710 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:59:03,710 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganButNotIteratedValueYetOwnerClustered 09:59:03,710 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@755644d1] 09:59:03,714 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:03,729 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:59:03,729 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:03,729 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:59:03,730 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:03,730 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,730 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:03,730 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,730 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:03,730 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:03,730 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91678] on Test-NodeB-10318 09:59:03,730 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #170, conn_id=1) 09:59:03,730 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91678, rsp_expected=true, UNICAST3: DATA, seqno=170, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,730 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,731 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:03,734 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91678, rsp_expected=true, UNICAST3: DATA, seqno=170, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,735 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #170, conn_id=1) 09:59:03,738 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#170 09:59:03,738 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91678 09:59:03,739 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:03,739 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:03,743 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:38153. timeout=10000 (MILLISECONDS) 09:59:03,744 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38153. Timeout=10000 (MILLISECONDS) 09:59:03,751 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38153} 09:59:03,760 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38153}. Current=null 09:59:03,762 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38153}) => true 09:59:03,762 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38153}. WAITING => ACQUIRED 09:59:03,762 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38153} successfully acquired the lock. 09:59:03,762 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,762 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:03,762 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:03,762 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3971d399] 09:59:03,763 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:03,763 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:59:03,765 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:38153. timeout=10000 (MILLISECONDS) 09:59:03,765 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38153. Timeout=10000 (MILLISECONDS) 09:59:03,765 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38153} 09:59:03,765 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:03,765 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:59:03,774 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:03,774 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:03,774 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:59:03,774 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4026c52c){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:03,774 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:03,774 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,774 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,774 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:03,777 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:03,778 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91684] on Test-NodeC-52778 09:59:03,778 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #71, conn_id=1) 09:59:03,778 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91684, rsp_expected=true, UNICAST3: DATA, seqno=71, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,778 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,778 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:59:03,779 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91684, rsp_expected=true, UNICAST3: DATA, seqno=71, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,779 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #71, conn_id=1) 09:59:03,784 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#71 09:59:03,785 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91684 09:59:03,794 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:03,794 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:03,798 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,798 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:03,811 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:03,817 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4e1b21ef] 09:59:03,817 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:03,817 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:59:03,817 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:03,817 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:59:03,817 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(46835ddd){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(46835ddd){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:03,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91684 to Test-NodeB-10318 09:59:03,821 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #71, conn_id=1) 09:59:03,821 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91684, rsp_expected=true, UNICAST3: DATA, seqno=71, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,821 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38153 09:59:03,821 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,821 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:03,821 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91684, rsp_expected=true, UNICAST3: DATA, seqno=71, conn_id=1, TP: [cluster_name=ISPN] 09:59:03,821 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #71, conn_id=1) 09:59:03,821 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#71 09:59:03,821 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:03,821 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:03,821 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4026c52c){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:03,825 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:59:03,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:03,827 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:38153 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38153. 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38153}. ACQUIRED => RELEASED 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38153}? true 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38153} 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38153}, null) => true 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:03,830 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:03,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91678 to Test-NodeA-7051 09:59:03,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #172, conn_id=0) 09:59:03,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91678, rsp_expected=true, UNICAST3: DATA, seqno=172, TP: [cluster_name=ISPN] 09:59:03,831 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:38153 09:59:03,831 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,831 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:03,834 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91678, rsp_expected=true, UNICAST3: DATA, seqno=172, TP: [cluster_name=ISPN] 09:59:03,834 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #172, conn_id=0) 09:59:03,834 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#172 09:59:03,834 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:03,834 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:03,834 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:03,834 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@37ae9166] 09:59:03,834 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:03,834 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:59:03,834 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:03,834 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:59:03,834 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:03,834 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,834 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:03,834 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,834 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:03,834 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:03,834 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91694] on Test-NodeC-52778 09:59:03,834 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #293, conn_id=2) 09:59:03,834 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91694, rsp_expected=true, UNICAST3: DATA, seqno=293, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,834 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,834 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:03,835 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91694, rsp_expected=true, UNICAST3: DATA, seqno=293, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,846 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #293, conn_id=2) 09:59:03,846 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#293 09:59:03,846 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91694 09:59:03,846 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:03,846 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:03,846 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:38160. timeout=10000 (MILLISECONDS) 09:59:03,846 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38160. Timeout=10000 (MILLISECONDS) 09:59:03,851 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38160} 09:59:03,856 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38160}. Current=null 09:59:03,856 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38160}) => true 09:59:03,856 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38160}. WAITING => ACQUIRED 09:59:03,856 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38160} successfully acquired the lock. 09:59:03,856 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,856 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:03,856 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:03,856 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@37e626cd] 09:59:03,856 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:03,856 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:59:03,856 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:38160. timeout=10000 (MILLISECONDS) 09:59:03,857 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38160. Timeout=10000 (MILLISECONDS) 09:59:03,874 TRACE (Timer-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:03,874 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:03,874 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:59:03,874 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:03,874 TRACE (INT-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeA-7051: mine: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:03,858 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38160} 09:59:03,878 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:03,878 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:59:03,878 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:03,878 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:03,878 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:59:03,883 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5b216140){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:03,883 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:03,885 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,886 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:03,889 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:03,889 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:03,889 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91698] on Test-NodeA-7051 09:59:03,889 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #296, conn_id=0) 09:59:03,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91698, rsp_expected=true, UNICAST3: DATA, seqno=296, TP: [cluster_name=ISPN] 09:59:03,892 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,906 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:03,909 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91698, rsp_expected=true, UNICAST3: DATA, seqno=296, TP: [cluster_name=ISPN] 09:59:03,909 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #296, conn_id=0) 09:59:03,909 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#296 09:59:03,909 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91698 09:59:03,909 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:03,910 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:03,913 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:03,913 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6ec83c41] 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(67050753){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:03,914 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:03,925 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(67050753){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:03,926 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:59:03,927 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:03,930 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:03,931 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:59:03,934 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:59:03,935 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:03,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:03,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91698 to Test-NodeC-52778 09:59:03,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #294, conn_id=2) 09:59:03,939 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91698, rsp_expected=true, UNICAST3: DATA, seqno=294, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,942 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,942 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:03,942 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38160 09:59:03,947 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #170) 09:59:03,947 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91698, rsp_expected=true, UNICAST3: DATA, seqno=294, conn_id=2, TP: [cluster_name=ISPN] 09:59:03,952 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #71) 09:59:03,952 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=71, conn_id=1, ts=98, TP: [cluster_name=ISPN] 09:59:03,952 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #293) 09:59:03,952 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,952 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:03,952 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=71, conn_id=1, ts=98, TP: [cluster_name=ISPN] 09:59:03,952 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #71, conn-id=1, ts=98) 09:59:03,952 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=293, conn_id=2, ts=99, TP: [cluster_name=ISPN] 09:59:03,953 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,954 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:03,954 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=293, conn_id=2, ts=99, TP: [cluster_name=ISPN] 09:59:03,954 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #293, conn-id=2, ts=99) 09:59:03,947 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=170, conn_id=1, ts=95, TP: [cluster_name=ISPN] 09:59:03,961 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,962 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:03,962 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=170, conn_id=1, ts=95, TP: [cluster_name=ISPN] 09:59:03,962 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #170, conn-id=1, ts=95) 09:59:03,961 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #71) 09:59:03,960 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #294, conn_id=2) 09:59:03,964 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#294 09:59:03,963 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=71, conn_id=1, ts=96, TP: [cluster_name=ISPN] 09:59:03,964 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,964 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:03,964 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:03,963 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #172) 09:59:03,966 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=172, ts=111, TP: [cluster_name=ISPN] 09:59:03,966 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #296) 09:59:03,966 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=296, ts=112, TP: [cluster_name=ISPN] 09:59:03,966 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:03,966 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:03,966 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=71, conn_id=1, ts=96, TP: [cluster_name=ISPN] 09:59:03,966 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #71, conn-id=1, ts=96) 09:59:03,967 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:03,970 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5b216140){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:03,970 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:59:03,970 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:03,970 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:03,966 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=172, ts=111, TP: [cluster_name=ISPN] 09:59:03,972 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #172, conn-id=0, ts=111) 09:59:03,974 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:03,970 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:59:03,976 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:59:03,975 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:03,978 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:03,977 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=296, ts=112, TP: [cluster_name=ISPN] 09:59:03,978 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:38160 09:59:03,980 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38160. 09:59:03,980 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38160}. ACQUIRED => RELEASED 09:59:03,993 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38160}? true 09:59:03,993 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38160} 09:59:03,993 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38160}, null) => true 09:59:03,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:03,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:03,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91694 to Test-NodeA-7051 09:59:03,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #297, conn_id=0) 09:59:03,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91694, rsp_expected=true, UNICAST3: DATA, seqno=297, TP: [cluster_name=ISPN] 09:59:03,994 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:38160 09:59:03,994 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:03,994 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:03,994 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91694, rsp_expected=true, UNICAST3: DATA, seqno=297, TP: [cluster_name=ISPN] 09:59:03,984 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #296, conn-id=0, ts=112) 09:59:03,994 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #297, conn_id=0) 09:59:03,999 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#297 09:59:04,000 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,004 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:04,009 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,009 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3d56b5a0] 09:59:04,009 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:04,014 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:59:04,014 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:04,014 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:59:04,014 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,014 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,014 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:04,014 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,014 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,014 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:04,014 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91713] on Test-NodeC-52778 09:59:04,014 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #295, conn_id=2) 09:59:04,014 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91713, rsp_expected=true, UNICAST3: DATA, seqno=295, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,014 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,014 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:04,015 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91713, rsp_expected=true, UNICAST3: DATA, seqno=295, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,015 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #295, conn_id=2) 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#295 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91713 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:38172. timeout=10000 (MILLISECONDS) 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38172. Timeout=10000 (MILLISECONDS) 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38172} 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38172}. Current=null 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38172}) => true 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38172}. WAITING => ACQUIRED 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38172} successfully acquired the lock. 09:59:04,016 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1452b6f3] 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:38172. timeout=10000 (MILLISECONDS) 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38172. Timeout=10000 (MILLISECONDS) 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38172} 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(29fda404){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,016 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,030 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,030 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,030 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,030 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:04,030 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91714] on Test-NodeB-10318 09:59:04,047 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #72, conn_id=1) 09:59:04,050 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91714, rsp_expected=true, UNICAST3: DATA, seqno=72, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,050 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:04,064 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:04,066 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91714, rsp_expected=true, UNICAST3: DATA, seqno=72, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,066 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #72, conn_id=1) 09:59:04,066 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#72 09:59:04,066 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91714 09:59:04,067 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:04,067 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,067 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@f603887] 09:59:04,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:59:04,067 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:04,079 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:59:04,079 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:59:04,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(11e380c7){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,091 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(11e380c7){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91714 to Test-NodeC-52778 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #72, conn_id=1) 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91714, rsp_expected=true, UNICAST3: DATA, seqno=72, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,092 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38172 09:59:04,092 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,092 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:59:04,106 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91714, rsp_expected=true, UNICAST3: DATA, seqno=72, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,108 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #72, conn_id=1) 09:59:04,109 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#72 09:59:04,111 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,111 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:04,111 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(29fda404){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,123 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:59:04,123 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,226 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,226 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:59:04,237 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:59:04,237 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,237 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:38172 09:59:04,248 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38172. 09:59:04,248 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38172}. ACQUIRED => RELEASED 09:59:04,257 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38172}? true 09:59:04,257 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38172} 09:59:04,261 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38172}, null) => true 09:59:04,261 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:04,261 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,264 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91713 to Test-NodeA-7051 09:59:04,268 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #298, conn_id=0) 09:59:04,268 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91713, rsp_expected=true, UNICAST3: DATA, seqno=298, TP: [cluster_name=ISPN] 09:59:04,269 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:38172 09:59:04,269 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,269 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:04,272 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91713, rsp_expected=true, UNICAST3: DATA, seqno=298, TP: [cluster_name=ISPN] 09:59:04,277 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #298, conn_id=0) 09:59:04,279 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#298 09:59:04,279 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,284 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:04,284 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,284 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3e49503f] 09:59:04,375 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:04,375 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:59:04,375 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:04,376 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:59:04,376 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,382 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,382 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:04,382 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,383 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,383 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:04,383 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91744] on Test-NodeC-52778 09:59:04,383 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #296, conn_id=2) 09:59:04,383 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91744, rsp_expected=true, UNICAST3: DATA, seqno=296, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,383 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,383 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:04,385 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91744, rsp_expected=true, UNICAST3: DATA, seqno=296, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,385 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #296, conn_id=2) 09:59:04,389 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#296 09:59:04,389 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91744 09:59:04,389 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:04,389 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,389 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:38190. timeout=10000 (MILLISECONDS) 09:59:04,389 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38190. Timeout=10000 (MILLISECONDS) 09:59:04,393 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38190} 09:59:04,394 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38190}. Current=null 09:59:04,397 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38190}) => true 09:59:04,397 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38190}. WAITING => ACQUIRED 09:59:04,399 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38190} successfully acquired the lock. 09:59:04,399 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,399 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,399 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,408 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@55705502] 09:59:04,408 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,408 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:59:04,408 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:38190. timeout=10000 (MILLISECONDS) 09:59:04,410 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38190. Timeout=10000 (MILLISECONDS) 09:59:04,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38190} 09:59:04,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:04,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:59:04,414 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,418 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,419 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:59:04,419 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(31cf25da){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,423 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,424 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,425 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:04,426 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91756] on Test-NodeB-10318 09:59:04,426 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #73, conn_id=1) 09:59:04,426 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91756, rsp_expected=true, UNICAST3: DATA, seqno=73, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,427 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:04,428 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:04,428 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91756, rsp_expected=true, UNICAST3: DATA, seqno=73, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,428 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #73, conn_id=1) 09:59:04,428 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#73 09:59:04,429 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91756 09:59:04,429 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:04,429 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,434 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,434 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,434 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,443 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@34238329] 09:59:04,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,447 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:59:04,453 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:04,455 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:59:04,456 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,455 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #72) 09:59:04,457 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,457 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:59:04,458 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3d6b2d8a){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,457 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=72, conn_id=1, ts=100, TP: [cluster_name=ISPN] 09:59:04,458 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #296) 09:59:04,458 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=296, conn_id=2, ts=101, TP: [cluster_name=ISPN] 09:59:04,458 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,458 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:04,459 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:04,459 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,460 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:04,460 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=72, conn_id=1, ts=100, TP: [cluster_name=ISPN] 09:59:04,460 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=296, conn_id=2, ts=101, TP: [cluster_name=ISPN] 09:59:04,460 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #296, conn-id=2, ts=101) 09:59:04,460 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #72, conn-id=1, ts=100) 09:59:04,461 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,461 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3d6b2d8a){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,461 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:59:04,463 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,464 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #73) 09:59:04,464 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=73, conn_id=1, ts=97, TP: [cluster_name=ISPN] 09:59:04,468 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,474 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #298) 09:59:04,474 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=298, ts=113, TP: [cluster_name=ISPN] 09:59:04,474 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,474 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:04,474 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=298, ts=113, TP: [cluster_name=ISPN] 09:59:04,474 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #298, conn-id=0, ts=113) 09:59:04,468 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:59:04,467 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,475 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:04,475 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:59:04,476 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,477 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,477 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91756 to Test-NodeC-52778 09:59:04,476 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=73, conn_id=1, ts=97, TP: [cluster_name=ISPN] 09:59:04,478 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #73, conn-id=1, ts=97) 09:59:04,479 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #73, conn_id=1) 09:59:04,479 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91756, rsp_expected=true, UNICAST3: DATA, seqno=73, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,480 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,480 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:59:04,480 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38190 09:59:04,481 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91756, rsp_expected=true, UNICAST3: DATA, seqno=73, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,482 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #73, conn_id=1) 09:59:04,482 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#73 09:59:04,483 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,483 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:04,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(31cf25da){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,485 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:59:04,485 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,485 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,487 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:59:04,487 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:59:04,489 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,492 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:38190 09:59:04,492 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38190. 09:59:04,497 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38190}. ACQUIRED => RELEASED 09:59:04,498 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38190}? true 09:59:04,499 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38190} 09:59:04,499 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38190}, null) => true 09:59:04,499 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:04,506 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,506 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91744 to Test-NodeA-7051 09:59:04,508 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #299, conn_id=0) 09:59:04,510 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91744, rsp_expected=true, UNICAST3: DATA, seqno=299, TP: [cluster_name=ISPN] 09:59:04,511 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,511 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:38190 09:59:04,512 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:04,512 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91744, rsp_expected=true, UNICAST3: DATA, seqno=299, TP: [cluster_name=ISPN] 09:59:04,512 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #299, conn_id=0) 09:59:04,514 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#299 09:59:04,514 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,514 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:04,516 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,517 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1f992eaa] 09:59:04,517 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:04,517 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:59:04,517 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:04,517 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:59:04,517 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,517 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,517 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:04,517 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,517 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,517 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:04,517 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91777] on Test-NodeC-52778 09:59:04,517 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #297, conn_id=2) 09:59:04,518 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91777, rsp_expected=true, UNICAST3: DATA, seqno=297, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,518 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,518 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:04,518 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91777, rsp_expected=true, UNICAST3: DATA, seqno=297, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,518 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #297, conn_id=2) 09:59:04,518 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#297 09:59:04,519 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91777 09:59:04,528 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:04,528 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,528 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:38200. timeout=10000 (MILLISECONDS) 09:59:04,529 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38200. Timeout=10000 (MILLISECONDS) 09:59:04,531 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38200} 09:59:04,531 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38200}. Current=null 09:59:04,533 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38200}) => true 09:59:04,535 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38200}. WAITING => ACQUIRED 09:59:04,535 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38200} successfully acquired the lock. 09:59:04,535 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,535 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,535 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,537 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@462d6ece] 09:59:04,537 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,538 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:59:04,538 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:38200. timeout=10000 (MILLISECONDS) 09:59:04,540 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38200. Timeout=10000 (MILLISECONDS) 09:59:04,540 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38200} 09:59:04,541 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:04,541 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:59:04,542 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,543 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,544 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:59:04,544 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(62e8fc50){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,545 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,546 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,548 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,548 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,548 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:04,549 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91785] on Test-NodeA-7051 09:59:04,552 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #300, conn_id=0) 09:59:04,552 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91785, rsp_expected=true, UNICAST3: DATA, seqno=300, TP: [cluster_name=ISPN] 09:59:04,552 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,552 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:04,557 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91785, rsp_expected=true, UNICAST3: DATA, seqno=300, TP: [cluster_name=ISPN] 09:59:04,559 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #300, conn_id=0) 09:59:04,559 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#300 09:59:04,559 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91785 09:59:04,559 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:04,559 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,559 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,559 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,560 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,561 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@40a09321] 09:59:04,562 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,563 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:59:04,564 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:04,565 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:59:04,566 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,569 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,569 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:59:04,569 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(5c2ea4c5){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,569 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,571 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,571 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(5c2ea4c5){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,572 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:59:04,572 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,573 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,574 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:59:04,575 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:59:04,575 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,576 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,576 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91785 to Test-NodeC-52778 09:59:04,576 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #298, conn_id=2) 09:59:04,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91785, rsp_expected=true, UNICAST3: DATA, seqno=298, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,577 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38200 09:59:04,577 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,579 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:04,580 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91785, rsp_expected=true, UNICAST3: DATA, seqno=298, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,580 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #298, conn_id=2) 09:59:04,581 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#298 09:59:04,592 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,594 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:04,594 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(62e8fc50){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,594 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:59:04,595 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,595 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,598 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:59:04,600 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:59:04,600 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,600 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:38200 09:59:04,601 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38200. 09:59:04,601 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38200}. ACQUIRED => RELEASED 09:59:04,602 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38200}? true 09:59:04,602 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38200} 09:59:04,604 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38200}, null) => true 09:59:04,604 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:04,605 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,606 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91777 to Test-NodeA-7051 09:59:04,606 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #301, conn_id=0) 09:59:04,608 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91777, rsp_expected=true, UNICAST3: DATA, seqno=301, TP: [cluster_name=ISPN] 09:59:04,609 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,611 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:04,609 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:38200 09:59:04,612 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91777, rsp_expected=true, UNICAST3: DATA, seqno=301, TP: [cluster_name=ISPN] 09:59:04,612 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #301, conn_id=0) 09:59:04,612 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#301 09:59:04,616 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,616 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:04,629 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,629 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2a8c705a] 09:59:04,629 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:04,631 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:59:04,631 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:38206. timeout=10000 (MILLISECONDS) 09:59:04,632 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38206. Timeout=10000 (MILLISECONDS) 09:59:04,632 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38206} 09:59:04,632 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38206}. Current=null 09:59:04,633 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38206}) => true 09:59:04,633 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38206}. WAITING => ACQUIRED 09:59:04,633 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38206} successfully acquired the lock. 09:59:04,634 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:59:04,635 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:59:04,637 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,637 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,638 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:59:04,638 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(281f06e8){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,638 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,638 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,638 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:59:04,638 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,638 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,638 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:04,638 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91796] on Test-NodeB-10318 09:59:04,638 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #171, conn_id=1) 09:59:04,638 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91796, rsp_expected=true, UNICAST3: DATA, seqno=171, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,638 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:04,638 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:04,639 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91796, rsp_expected=true, UNICAST3: DATA, seqno=171, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,640 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #171, conn_id=1) 09:59:04,640 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#171 09:59:04,642 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91796 09:59:04,642 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:04,642 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,644 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,644 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,644 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,644 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@33c19ea0] 09:59:04,645 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,645 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:59:04,645 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:04,645 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:59:04,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:59:04,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3e29d5a7){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,648 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,655 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,655 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3e29d5a7){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:59:04,657 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:59:04,664 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:59:04,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,665 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91796 to Test-NodeA-7051 09:59:04,667 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #173, conn_id=0) 09:59:04,674 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91796, rsp_expected=true, UNICAST3: DATA, seqno=173, TP: [cluster_name=ISPN] 09:59:04,680 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,680 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:04,680 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38206 09:59:04,685 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91796, rsp_expected=true, UNICAST3: DATA, seqno=173, TP: [cluster_name=ISPN] 09:59:04,686 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #173, conn_id=0) 09:59:04,686 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#173 09:59:04,687 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,687 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:04,687 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(281f06e8){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,688 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:59:04,688 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,693 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,693 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:59:04,695 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:59:04,696 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,696 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:38206 09:59:04,696 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38206. 09:59:04,696 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38206}. ACQUIRED => RELEASED 09:59:04,697 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38206}? true 09:59:04,697 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38206} 09:59:04,697 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38206}, null) => true 09:59:04,697 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:04,707 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@bbe05d3] 09:59:04,708 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:04,710 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:59:04,710 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:04,710 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:59:04,710 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,711 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,711 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:04,711 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,711 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,712 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:04,712 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91807] on Test-NodeC-52778 09:59:04,712 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #299, conn_id=2) 09:59:04,712 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91807, rsp_expected=true, UNICAST3: DATA, seqno=299, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,712 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,712 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:04,712 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91807, rsp_expected=true, UNICAST3: DATA, seqno=299, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,712 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #299, conn_id=2) 09:59:04,712 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#299 09:59:04,712 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91807 09:59:04,712 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:04,713 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,713 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:38214. timeout=10000 (MILLISECONDS) 09:59:04,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38214. Timeout=10000 (MILLISECONDS) 09:59:04,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38214} 09:59:04,714 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38214}. Current=null 09:59:04,716 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38214}) => true 09:59:04,717 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38214}. WAITING => ACQUIRED 09:59:04,717 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38214} successfully acquired the lock. 09:59:04,719 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,719 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,719 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,719 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@44f8a129] 09:59:04,719 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,720 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:59:04,720 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:38214. timeout=10000 (MILLISECONDS) 09:59:04,720 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38214. Timeout=10000 (MILLISECONDS) 09:59:04,720 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38214} 09:59:04,720 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:04,720 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:59:04,720 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,721 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,721 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:59:04,721 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(79af3e2d){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,721 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,721 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,722 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,722 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,722 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:04,722 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91810] on Test-NodeA-7051 09:59:04,724 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #302, conn_id=0) 09:59:04,725 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91810, rsp_expected=true, UNICAST3: DATA, seqno=302, TP: [cluster_name=ISPN] 09:59:04,726 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,726 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:04,728 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91810, rsp_expected=true, UNICAST3: DATA, seqno=302, TP: [cluster_name=ISPN] 09:59:04,728 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #302, conn_id=0) 09:59:04,729 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#302 09:59:04,729 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91810 09:59:04,729 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:04,729 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,729 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,729 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,735 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,747 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@732bb135] 09:59:04,747 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3c5b1f9c){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3c5b1f9c){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,756 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:59:04,757 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:59:04,757 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,757 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,757 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91810 to Test-NodeC-52778 09:59:04,757 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #300, conn_id=2) 09:59:04,757 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91810, rsp_expected=true, UNICAST3: DATA, seqno=300, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,757 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38214 09:59:04,757 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,759 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:04,759 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91810, rsp_expected=true, UNICAST3: DATA, seqno=300, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,760 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #300, conn_id=2) 09:59:04,760 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#300 09:59:04,760 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,760 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:04,762 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(79af3e2d){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,763 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:59:04,763 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,763 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,763 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:59:04,764 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:59:04,764 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,766 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:38214 09:59:04,766 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38214. 09:59:04,766 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38214}. ACQUIRED => RELEASED 09:59:04,769 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38214}? true 09:59:04,769 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38214} 09:59:04,772 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38214}, null) => true 09:59:04,772 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:04,773 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,773 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91807 to Test-NodeA-7051 09:59:04,775 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #303, conn_id=0) 09:59:04,777 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91807, rsp_expected=true, UNICAST3: DATA, seqno=303, TP: [cluster_name=ISPN] 09:59:04,777 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:38214 09:59:04,777 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,778 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:04,782 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91807, rsp_expected=true, UNICAST3: DATA, seqno=303, TP: [cluster_name=ISPN] 09:59:04,782 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #303, conn_id=0) 09:59:04,782 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#303 09:59:04,782 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,783 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:04,783 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,784 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@65cec0f5] 09:59:04,784 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:04,784 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:59:04,785 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:04,785 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:59:04,786 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,786 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,787 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:04,787 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,787 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,787 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:04,788 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91825] on Test-NodeC-52778 09:59:04,788 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #301, conn_id=2) 09:59:04,789 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91825, rsp_expected=true, UNICAST3: DATA, seqno=301, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,789 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,789 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:04,790 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91825, rsp_expected=true, UNICAST3: DATA, seqno=301, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,790 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #301, conn_id=2) 09:59:04,790 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#301 09:59:04,790 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91825 09:59:04,791 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:04,791 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,791 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:38225. timeout=10000 (MILLISECONDS) 09:59:04,791 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38225. Timeout=10000 (MILLISECONDS) 09:59:04,793 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38225} 09:59:04,794 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38225}. Current=null 09:59:04,797 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38225}) => true 09:59:04,798 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38225}. WAITING => ACQUIRED 09:59:04,798 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38225} successfully acquired the lock. 09:59:04,799 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,799 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,801 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,801 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@349550a9] 09:59:04,803 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,803 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:59:04,805 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:38225. timeout=10000 (MILLISECONDS) 09:59:04,805 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38225. Timeout=10000 (MILLISECONDS) 09:59:04,805 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38225} 09:59:04,805 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:04,805 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:59:04,805 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,806 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,806 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:59:04,806 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(89acebf){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,807 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,809 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,810 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,810 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,814 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:04,899 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91840] on Test-NodeA-7051 09:59:04,900 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #304, conn_id=0) 09:59:04,900 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91840, rsp_expected=true, UNICAST3: DATA, seqno=304, TP: [cluster_name=ISPN] 09:59:04,900 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,902 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:04,903 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91840, rsp_expected=true, UNICAST3: DATA, seqno=304, TP: [cluster_name=ISPN] 09:59:04,903 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #304, conn_id=0) 09:59:04,905 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#304 09:59:04,905 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91840 09:59:04,905 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:04,905 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,907 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7826baad] 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(510731e0){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(510731e0){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91840 to Test-NodeC-52778 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #302, conn_id=2) 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91840, rsp_expected=true, UNICAST3: DATA, seqno=302, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,907 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38225 09:59:04,907 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,907 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:04,908 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91840, rsp_expected=true, UNICAST3: DATA, seqno=302, conn_id=2, TP: [cluster_name=ISPN] 09:59:04,917 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #302, conn_id=2) 09:59:04,917 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#302 09:59:04,917 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,917 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:04,917 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(89acebf){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,917 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:59:04,917 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,917 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,917 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:38225 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38225. 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38225}. ACQUIRED => RELEASED 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38225}? true 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38225} 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38225}, null) => true 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91825 to Test-NodeA-7051 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #305, conn_id=0) 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91825, rsp_expected=true, UNICAST3: DATA, seqno=305, TP: [cluster_name=ISPN] 09:59:04,918 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:38225 09:59:04,918 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,918 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:04,918 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91825, rsp_expected=true, UNICAST3: DATA, seqno=305, TP: [cluster_name=ISPN] 09:59:04,919 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #305, conn_id=0) 09:59:04,920 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#305 09:59:04,920 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,920 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:04,920 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,920 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@454ccc35] 09:59:04,920 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:04,920 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:59:04,920 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:04,923 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:59:04,923 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,925 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,925 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:04,925 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,926 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,926 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:04,926 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91847] on Test-NodeB-10318 09:59:04,926 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #172, conn_id=1) 09:59:04,927 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91847, rsp_expected=true, UNICAST3: DATA, seqno=172, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,927 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:04,927 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:04,927 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91847, rsp_expected=true, UNICAST3: DATA, seqno=172, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,927 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #172, conn_id=1) 09:59:04,927 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#172 09:59:04,927 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91847 09:59:04,927 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:04,928 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,930 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:38232. timeout=10000 (MILLISECONDS) 09:59:04,931 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38232. Timeout=10000 (MILLISECONDS) 09:59:04,931 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38232} 09:59:04,933 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38232}. Current=null 09:59:04,933 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38232}) => true 09:59:04,933 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38232}. WAITING => ACQUIRED 09:59:04,935 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38232} successfully acquired the lock. 09:59:04,935 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,935 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,936 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,936 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@16bb3380] 09:59:04,936 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,936 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:59:04,937 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:38232. timeout=10000 (MILLISECONDS) 09:59:04,938 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38232. Timeout=10000 (MILLISECONDS) 09:59:04,939 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38232} 09:59:04,940 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:04,942 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:59:04,943 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,946 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,946 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:59:04,946 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(72584ba0){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,954 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,954 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,956 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,956 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:04,958 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #73) 09:59:04,958 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=73, conn_id=1, ts=102, TP: [cluster_name=ISPN] 09:59:04,958 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #302) 09:59:04,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91855] on Test-NodeC-52778 09:59:04,958 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #74, conn_id=1) 09:59:04,958 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:04,960 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91855, rsp_expected=true, UNICAST3: DATA, seqno=74, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,961 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,963 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:59:04,963 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91855, rsp_expected=true, UNICAST3: DATA, seqno=74, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,963 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #74, conn_id=1) 09:59:04,963 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#74 09:59:04,963 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91855 09:59:04,961 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=302, conn_id=2, ts=103, TP: [cluster_name=ISPN] 09:59:04,961 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:04,963 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:04,963 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,963 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:04,963 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:04,963 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1a298a17] 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(3af34f2){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3af34f2){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,967 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:59:04,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:59:04,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91855 to Test-NodeB-10318 09:59:04,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #74, conn_id=1) 09:59:04,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91855, rsp_expected=true, UNICAST3: DATA, seqno=74, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38232 09:59:04,963 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:04,963 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=73, conn_id=1, ts=102, TP: [cluster_name=ISPN] 09:59:04,968 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #73, conn-id=1, ts=102) 09:59:04,968 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:04,967 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #172) 09:59:04,968 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:04,968 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=172, conn_id=1, ts=98, TP: [cluster_name=ISPN] 09:59:04,967 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=302, conn_id=2, ts=103, TP: [cluster_name=ISPN] 09:59:04,968 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91855, rsp_expected=true, UNICAST3: DATA, seqno=74, conn_id=1, TP: [cluster_name=ISPN] 09:59:04,970 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #302, conn-id=2, ts=103) 09:59:04,968 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,974 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #173) 09:59:04,975 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=173, ts=114, TP: [cluster_name=ISPN] 09:59:04,975 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #305) 09:59:04,975 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:04,975 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=305, ts=115, TP: [cluster_name=ISPN] 09:59:04,975 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:04,976 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:04,976 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:04,976 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=173, ts=114, TP: [cluster_name=ISPN] 09:59:04,976 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #173, conn-id=0, ts=114) 09:59:04,976 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=305, ts=115, TP: [cluster_name=ISPN] 09:59:04,976 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #305, conn-id=0, ts=115) 09:59:04,970 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #74, conn_id=1) 09:59:04,978 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#74 09:59:04,978 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,978 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(72584ba0){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:38232 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38232. 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38232}. ACQUIRED => RELEASED 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38232}? true 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38232} 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38232}, null) => true 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91847 to Test-NodeA-7051 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #174, conn_id=0) 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91847, rsp_expected=true, UNICAST3: DATA, seqno=174, TP: [cluster_name=ISPN] 09:59:04,978 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:38232 09:59:04,975 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:04,980 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=172, conn_id=1, ts=98, TP: [cluster_name=ISPN] 09:59:04,980 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:04,981 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:04,981 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #172, conn-id=1, ts=98) 09:59:04,982 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91847, rsp_expected=true, UNICAST3: DATA, seqno=174, TP: [cluster_name=ISPN] 09:59:04,984 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #174, conn_id=0) 09:59:04,984 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#174 09:59:04,984 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:04,984 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:04,989 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:04,991 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5d562e24] 09:59:04,991 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:04,992 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:59:04,992 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:04,992 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:59:04,992 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:04,994 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:04,994 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:04,996 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:04,997 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:04,998 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:04,999 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91864] on Test-NodeC-52778 09:59:05,000 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #303, conn_id=2) 09:59:05,008 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91864, rsp_expected=true, UNICAST3: DATA, seqno=303, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,008 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,008 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:05,008 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91864, rsp_expected=true, UNICAST3: DATA, seqno=303, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,008 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #303, conn_id=2) 09:59:05,008 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#303 09:59:05,008 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91864 09:59:05,008 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:05,009 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,009 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:38240. timeout=10000 (MILLISECONDS) 09:59:05,010 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38240. Timeout=10000 (MILLISECONDS) 09:59:05,010 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38240} 09:59:05,010 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38240}. Current=null 09:59:05,013 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38240}) => true 09:59:05,014 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38240}. WAITING => ACQUIRED 09:59:05,017 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38240} successfully acquired the lock. 09:59:05,017 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,017 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,018 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,019 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4ac0a12e] 09:59:05,019 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,020 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:59:05,021 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:38240. timeout=10000 (MILLISECONDS) 09:59:05,022 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38240. Timeout=10000 (MILLISECONDS) 09:59:05,022 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38240} 09:59:05,022 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:05,022 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:59:05,026 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,026 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,028 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:59:05,029 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(227be319){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,030 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,031 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,032 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,032 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,033 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:05,033 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91871] on Test-NodeA-7051 09:59:05,033 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #306, conn_id=0) 09:59:05,033 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91871, rsp_expected=true, UNICAST3: DATA, seqno=306, TP: [cluster_name=ISPN] 09:59:05,033 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,033 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:05,034 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91871, rsp_expected=true, UNICAST3: DATA, seqno=306, TP: [cluster_name=ISPN] 09:59:05,036 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #306, conn_id=0) 09:59:05,036 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#306 09:59:05,036 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91871 09:59:05,036 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:05,036 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,036 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7f8b80ec] 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1bc8d77e){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1bc8d77e){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:59:05,036 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:59:05,037 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,037 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,037 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91871 to Test-NodeC-52778 09:59:05,037 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #304, conn_id=2) 09:59:05,037 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91871, rsp_expected=true, UNICAST3: DATA, seqno=304, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,037 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38240 09:59:05,037 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,037 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:05,038 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91871, rsp_expected=true, UNICAST3: DATA, seqno=304, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,038 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #304, conn_id=2) 09:59:05,038 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#304 09:59:05,039 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,042 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:05,044 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(227be319){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,046 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:59:05,046 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,047 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,047 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:59:05,047 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:59:05,049 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,049 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:38240 09:59:05,049 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38240. 09:59:05,051 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38240}. ACQUIRED => RELEASED 09:59:05,052 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38240}? true 09:59:05,052 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38240} 09:59:05,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38240}, null) => true 09:59:05,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:05,053 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,055 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91864 to Test-NodeA-7051 09:59:05,055 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #307, conn_id=0) 09:59:05,055 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91864, rsp_expected=true, UNICAST3: DATA, seqno=307, TP: [cluster_name=ISPN] 09:59:05,055 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:38240 09:59:05,055 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,055 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:05,055 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91864, rsp_expected=true, UNICAST3: DATA, seqno=307, TP: [cluster_name=ISPN] 09:59:05,055 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #307, conn_id=0) 09:59:05,055 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#307 09:59:05,055 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,055 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:05,055 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,055 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:59:05,055 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:59:05,056 DEBUG (testng-Test:[]) [Test] Found key key-to-change0 with primary owner Test-NodeA-7051, segment 51 09:59:05,056 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5ed1bfc2] 09:59:05,056 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:05,056 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:59:05,056 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:38247. timeout=10000 (MILLISECONDS) 09:59:05,056 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38247. Timeout=10000 (MILLISECONDS) 09:59:05,056 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38247} 09:59:05,056 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38247}. Current=null 09:59:05,056 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38247}) => true 09:59:05,056 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38247}. WAITING => ACQUIRED 09:59:05,056 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38247} successfully acquired the lock. 09:59:05,056 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:59:05,056 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:59:05,056 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,056 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,056 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:59:05,056 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(7c1afc60){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,056 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,056 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,056 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:59:05,056 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,056 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,056 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:05,056 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91878] on Test-NodeB-10318 09:59:05,056 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #173, conn_id=1) 09:59:05,056 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91878, rsp_expected=true, UNICAST3: DATA, seqno=173, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,056 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (207 bytes (1035.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,056 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (210 bytes) 09:59:05,057 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91878, rsp_expected=true, UNICAST3: DATA, seqno=173, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,058 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #173, conn_id=1) 09:59:05,060 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#173 09:59:05,061 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91878 09:59:05,061 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:05,061 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,063 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@115a55cf] 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1ffa754a){key=key-to-change0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,063 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1ffa754a){key=key-to-change0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,066 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:59:05,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,068 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:59:05,074 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=initial-value} in container 09:59:05,075 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,076 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,076 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91878 to Test-NodeA-7051 09:59:05,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #175, conn_id=0) 09:59:05,078 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91878, rsp_expected=true, UNICAST3: DATA, seqno=175, TP: [cluster_name=ISPN] 09:59:05,080 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,080 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38247 09:59:05,081 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:05,084 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91878, rsp_expected=true, UNICAST3: DATA, seqno=175, TP: [cluster_name=ISPN] 09:59:05,085 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #175, conn_id=0) 09:59:05,085 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#175 09:59:05,085 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,086 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-to-change0, value=initial-value, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:05,086 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(7c1afc60){key=key-to-change0, value=initial-value, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,088 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:59:05,088 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,088 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=false valid=true changed=true created=true value=initial-value metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,088 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=initial-value 09:59:05,088 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-to-change0, value=initial-value} in container 09:59:05,088 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,088 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:38247 09:59:05,088 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38247. 09:59:05,089 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38247}. ACQUIRED => RELEASED 09:59:05,089 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38247}? true 09:59:05,089 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38247} 09:59:05,089 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38247}, null) => true 09:59:05,089 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:05,089 TRACE (ForkThread-1,Test:[]) [Test] Started fork callable.. 09:59:05,089 TRACE (testng-Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_invoked * 1 09:59:05,089 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 40262d12-abe7-43af-8738-c7d1de71f5bc 09:59:05,093 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@2cf52fda[Not completed] to remote execution at node Test-NodeB-10318 09:59:05,093 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@370a0a54] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,097 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@370a0a54], mode=SYNCHRONOUS, timeout=15000 09:59:05,097 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@370a0a54] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:05,097 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91885] on Test-NodeB-10318 09:59:05,097 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #174, conn_id=1) 09:59:05,105 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91885, rsp_expected=true, UNICAST3: DATA, seqno=174, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,105 TRACE (ForkThread-1,Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@4873b8bd[Not completed] to remote execution at node Test-NodeC-52778 09:59:05,106 TRACE (ForkThread-1,Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@370a0a54] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,105 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (236 bytes (1180.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,106 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:59:05,106 TRACE (ForkThread-1,Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@370a0a54], mode=SYNCHRONOUS, timeout=15000 09:59:05,107 TRACE (ForkThread-1,Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@370a0a54] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:05,107 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91885, rsp_expected=true, UNICAST3: DATA, seqno=174, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,110 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #174, conn_id=1) 09:59:05,110 TRACE (ForkThread-1,Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91888] on Test-NodeC-52778 09:59:05,110 TRACE (ForkThread-1,Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #305, conn_id=2) 09:59:05,110 TRACE (ForkThread-1,Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91888, rsp_expected=true, UNICAST3: DATA, seqno=305, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,110 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (237 bytes (1185.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,111 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (240 bytes) 09:59:05,111 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91888, rsp_expected=true, UNICAST3: DATA, seqno=305, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,111 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #305, conn_id=2) 09:59:05,111 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#305 09:59:05,111 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91888 09:59:05,111 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@58aab0ed] [sender=Test-NodeA-7051] 09:59:05,110 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#174 09:59:05,111 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:05,112 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@58aab0ed] 09:59:05,112 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,111 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91885 09:59:05,112 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 40262d12-abe7-43af-8738-c7d1de71f5bc 09:59:05,114 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1945f3d0] [sender=Test-NodeA-7051] 09:59:05,114 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@58aab0ed] 09:59:05,115 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91888 to Test-NodeA-7051 09:59:05,119 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:05,119 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,119 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1945f3d0] 09:59:05,119 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 40262d12-abe7-43af-8738-c7d1de71f5bc 09:59:05,119 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@1945f3d0] 09:59:05,120 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91885 to Test-NodeA-7051 09:59:05,120 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #176, conn_id=0) 09:59:05,120 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91885, rsp_expected=true, UNICAST3: DATA, seqno=176, TP: [cluster_name=ISPN] 09:59:05,120 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #308, conn_id=0) 09:59:05,120 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91888, rsp_expected=true, UNICAST3: DATA, seqno=308, TP: [cluster_name=ISPN] 09:59:05,120 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,120 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:05,120 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,121 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:05,121 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91885, rsp_expected=true, UNICAST3: DATA, seqno=176, TP: [cluster_name=ISPN] 09:59:05,121 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #176, conn_id=0) 09:59:05,123 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#176 09:59:05,122 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91888, rsp_expected=true, UNICAST3: DATA, seqno=308, TP: [cluster_name=ISPN] 09:59:05,123 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #308, conn_id=0) 09:59:05,123 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#308 09:59:05,123 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,124 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@370a0a54] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:05,124 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,124 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@370a0a54] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:05,125 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 40262d12-abe7-43af-8738-c7d1de71f5bc requests initial state for cache 09:59:05,125 TRACE (ForkThread-1,Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@16247ddd] 09:59:05,125 TRACE (ForkThread-1,Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:05,126 TRACE (ForkThread-1,Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_invoked * 1 (available = 1, total = 1) 09:59:05,126 TRACE (ForkThread-1,Test:[]) [CheckPoint] Waiting for event pre_retrieve_entry_released * 1 09:59:05,126 TRACE (testng-Test:[]) [CheckPoint] Received event pre_retrieve_entry_invoked * 1 (available = 0, total = 1) 09:59:05,126 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6acf3b53] 09:59:05,126 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id -1 09:59:05,126 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-to-change0'? true 09:59:05,126 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-to-change0 for owner=CommandInvocation:Test-NodeA-7051:38253. timeout=10000 (MILLISECONDS) 09:59:05,127 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38253. Timeout=10000 (MILLISECONDS) 09:59:05,127 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38253} 09:59:05,128 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38253}. Current=null 09:59:05,129 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38253}) => true 09:59:05,129 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38253}. WAITING => ACQUIRED 09:59:05,130 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38253} successfully acquired the lock. 09:59:05,130 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:59:05,131 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:59:05,131 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,131 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:59:05,131 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:59:05,133 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2dd28c20){key=key-to-change0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:05,133 TRACE (testng-Test:[]) [CallInterceptor] Invoking: RemoveCommand 09:59:05,133 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,134 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:59:05,134 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,134 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,134 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:05,134 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91895] on Test-NodeB-10318 09:59:05,134 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #175, conn_id=1) 09:59:05,134 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91895, rsp_expected=true, UNICAST3: DATA, seqno=175, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,135 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (172 bytes (860.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,137 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (175 bytes) 09:59:05,137 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=98 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91895, rsp_expected=true, UNICAST3: DATA, seqno=175, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,137 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #175, conn_id=1) 09:59:05,167 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#175 09:59:05,167 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91895 09:59:05,175 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} [sender=Test-NodeA-7051] 09:59:05,175 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,175 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,175 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, with originLocal flag set to false 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@bf034e9] 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}, topology id 5 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-to-change0'? false 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-to-change0'? true 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=key-to-change0, value=initial-value} (ignoreOwnership=false, isLocal=true) 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-to-change0 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(36ba141c){key=key-to-change0, value=initial-value, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: RemoveCommand 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(36ba141c){key=key-to-change0, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is initial-value 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=initial-value} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS}} 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91895 to Test-NodeA-7051 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #177, conn_id=0) 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91895, rsp_expected=true, UNICAST3: DATA, seqno=177, TP: [cluster_name=ISPN] 09:59:05,176 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38253 09:59:05,176 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (93 bytes (465.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,177 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (96 bytes) 09:59:05,177 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=19 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91895, rsp_expected=true, UNICAST3: DATA, seqno=177, TP: [cluster_name=ISPN] 09:59:05,177 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #177, conn_id=0) 09:59:05,183 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#177 09:59:05,183 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=initial-value} , received=true, suspected=false 09:59:05,183 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to RemoveCommand{key=key-to-change0, value=null, flags=[], valueMatcher=MATCH_ALWAYS} is {Test-NodeB-10318=SuccessfulResponse{responseValue=initial-value} } 09:59:05,187 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2dd28c20){key=key-to-change0, value=initial-value, oldValue=initial-value, isCreated=false, isChanged=true, isRemoved=true, isValid=false, isExpired=false, skipRemoteGet=false, metadata=EmbeddedMetadata{version=null}} 09:59:05,187 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-to-change0. Operation Flag=null, L1 invalidation=false 09:59:05,187 TRACE (testng-Test:[]) [CommitManager] Committing key=key-to-change0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,187 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-to-change0 removed=true valid=false changed=true created=false value=initial-value metadata=EmbeddedMetadata{version=null}, providedMetadata=null) 09:59:05,187 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is initial-value 09:59:05,187 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-to-change0]. owner=CommandInvocation:Test-NodeA-7051:38253 09:59:05,187 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38253. 09:59:05,187 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38253}. ACQUIRED => RELEASED 09:59:05,187 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38253}? true 09:59:05,187 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38253} 09:59:05,187 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38253}, null) => true 09:59:05,187 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:05,187 TRACE (testng-Test:[]) [CheckPoint] Triggering event pre_retrieve_entry_released * 999999999 (available = 999999999, total = 999999999) 09:59:05,187 TRACE (ForkThread-1,Test:[]) [CheckPoint] Received event pre_retrieve_entry_released * 1 (available = 999999998, total = 999999999) 09:59:05,187 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[ForkThread-1,Test,5,main] submitted iterator request for stream 09:59:05,196 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705117 09:59:05,196 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705117 excluding keys [] 09:59:05,197 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,197 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:59:05,197 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:05,197 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:05,197 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91904] on Test-NodeB-10318 09:59:05,197 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #176, conn_id=1) 09:59:05,197 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91904, rsp_expected=true, UNICAST3: DATA, seqno=176, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,197 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,197 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:59:05,199 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91904, rsp_expected=true, UNICAST3: DATA, seqno=176, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,199 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #176, conn_id=1) 09:59:05,200 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#176 09:59:05,200 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91904 09:59:05,200 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:59:05,200 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,200 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,200 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:05,200 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705117 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:05,200 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@334c8c40] 09:59:05,200 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:05,200 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705117 09:59:05,200 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705117 09:59:05,200 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705117 09:59:05,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:05,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705117 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:59:05,201 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705117 09:59:05,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,218 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:05,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:05,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91906] on Test-NodeA-7051 09:59:05,220 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #178, conn_id=0) 09:59:05,231 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91906, rsp_expected=true, UNICAST3: DATA, seqno=178, TP: [cluster_name=ISPN] 09:59:05,234 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (225 bytes (1125.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,234 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (228 bytes) 09:59:05,237 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=151 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91906, rsp_expected=true, UNICAST3: DATA, seqno=178, TP: [cluster_name=ISPN] 09:59:05,237 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #178, conn_id=0) 09:59:05,238 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#178 09:59:05,238 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91906 09:59:05,238 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:59:05,243 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:05,243 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:05,258 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705117 with [] suspected segments. 09:59:05,243 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,258 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:05,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:59:05,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:05,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91906 to Test-NodeB-10318 09:59:05,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #177, conn_id=1) 09:59:05,268 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91906, rsp_expected=true, UNICAST3: DATA, seqno=177, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,268 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,268 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:59:05,269 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91906, rsp_expected=true, UNICAST3: DATA, seqno=177, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,269 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #177, conn_id=1) 09:59:05,269 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#177 09:59:05,269 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:59:05,269 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:05,269 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:05,269 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91904 to Test-NodeA-7051 09:59:05,269 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #179, conn_id=0) 09:59:05,269 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91904, rsp_expected=true, UNICAST3: DATA, seqno=179, TP: [cluster_name=ISPN] 09:59:05,269 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,269 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:59:05,269 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91904, rsp_expected=true, UNICAST3: DATA, seqno=179, TP: [cluster_name=ISPN] 09:59:05,269 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #179, conn_id=0) 09:59:05,269 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#179 09:59:05,269 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:59:05,269 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:05,269 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705117 excluding keys [] 09:59:05,269 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,275 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:59:05,283 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:05,283 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:05,284 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91916] on Test-NodeC-52778 09:59:05,284 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #306, conn_id=2) 09:59:05,284 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91916, rsp_expected=true, UNICAST3: DATA, seqno=306, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,284 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (608 bytes (3040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,284 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (611 bytes) 09:59:05,289 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91916, rsp_expected=true, UNICAST3: DATA, seqno=306, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,289 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #306, conn_id=2) 09:59:05,289 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#306 09:59:05,289 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91916 09:59:05,289 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:59:05,288 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,296 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 0 09:59:05,296 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,297 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,297 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:05,296 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 1 09:59:05,306 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705117 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:05,309 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@53357bb0] 09:59:05,309 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 6 09:59:05,315 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 136 09:59:05,315 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 137 09:59:05,312 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:05,315 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 138 09:59:05,320 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 11 09:59:05,319 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705117 09:59:05,320 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705117 09:59:05,321 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705117 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Request Test-NodeA-705117 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705117 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91925] on Test-NodeA-7051 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #309, conn_id=0) 09:59:05,322 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91925, rsp_expected=true, UNICAST3: DATA, seqno=309, TP: [cluster_name=ISPN] 09:59:05,322 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (316 bytes (1580.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,320 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 142 09:59:05,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 144 09:59:05,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 17 09:59:05,322 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (319 bytes) 09:59:05,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 149 09:59:05,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 150 09:59:05,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 152 09:59:05,322 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 26 09:59:05,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 154 09:59:05,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 27 09:59:05,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 155 09:59:05,323 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=241 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91925, rsp_expected=true, UNICAST3: DATA, seqno=309, TP: [cluster_name=ISPN] 09:59:05,327 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #309, conn_id=0) 09:59:05,327 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#309 09:59:05,327 TRACE (OOB-1,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91925 09:59:05,324 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 156 09:59:05,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 29 09:59:05,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 157 09:59:05,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 32 09:59:05,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 160 09:59:05,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 33 09:59:05,337 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 161 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 34 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 36 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 165 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 38 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 39 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 168 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 42 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 44 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 46 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 177 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 178 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 52 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 53 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 54 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 182 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 55 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 183 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 184 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 57 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 186 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 59 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 64 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 65 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 193 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 194 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 198 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 202 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 75 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 204 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 77 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 206 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 207 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 80 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 208 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 209 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 211 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 84 09:59:05,339 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 87 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 88 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 216 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 217 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 91 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 92 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 97 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 226 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 100 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 230 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 231 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 232 09:59:05,340 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 106 09:59:05,329 TRACE (OOB-1,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:59:05,347 TRACE (OOB-1,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:05,347 TRACE (OOB-1,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,347 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:05,347 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705117 with [] suspected segments. 09:59:05,347 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 234 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 235 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 237 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 111 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 242 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 115 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 243 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 116 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 117 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 247 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 248 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 252 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 254 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 127 09:59:05,349 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:59:05,349 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:59:05,348 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:59:05,350 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705117 as completed! 09:59:05,350 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:05,350 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91925 to Test-NodeC-52778 09:59:05,350 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #307, conn_id=2) 09:59:05,350 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91925, rsp_expected=true, UNICAST3: DATA, seqno=307, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,350 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,350 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (80 bytes) 09:59:05,350 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91925, rsp_expected=true, UNICAST3: DATA, seqno=307, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,351 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #307, conn_id=2) 09:59:05,351 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#307 09:59:05,352 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:59:05,355 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:05,355 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:05,355 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91916 to Test-NodeA-7051 09:59:05,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #310, conn_id=0) 09:59:05,358 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91916, rsp_expected=true, UNICAST3: DATA, seqno=310, TP: [cluster_name=ISPN] 09:59:05,358 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,364 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (80 bytes) 09:59:05,365 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91916, rsp_expected=true, UNICAST3: DATA, seqno=310, TP: [cluster_name=ISPN] 09:59:05,366 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #310, conn_id=0) 09:59:05,366 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#310 09:59:05,366 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:59:05,366 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:05,367 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:05,367 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-705117 09:59:05,368 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:05,369 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:59:05,369 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705117 09:59:05,369 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705117 being completed: true 09:59:05,369 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,369 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 128 09:59:05,369 TRACE (async-thread-Test-NodeA-p23741-t2:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705117 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 3 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 5 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 134 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 7 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 9 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 12 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 140 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 13 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 141 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 143 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 145 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 146 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 20 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 22 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 23 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 25 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 28 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 162 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 35 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 163 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 37 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 166 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 167 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 169 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 170 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 43 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 171 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 172 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 173 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 174 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 175 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 176 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 49 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 50 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 51 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 179 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 56 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 185 09:59:05,371 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 58 09:59:05,372 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 187 09:59:05,373 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 188 09:59:05,373 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 61 09:59:05,373 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 189 09:59:05,373 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 62 09:59:05,373 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 190 09:59:05,373 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 191 09:59:05,373 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 192 09:59:05,373 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 66 09:59:05,375 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 68 09:59:05,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 196 09:59:05,377 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 197 09:59:05,378 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 70 09:59:05,378 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 199 09:59:05,379 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 200 09:59:05,380 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 73 09:59:05,380 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 79 09:59:05,382 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 212 09:59:05,384 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 213 09:59:05,384 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 214 09:59:05,384 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 215 09:59:05,384 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 89 09:59:05,385 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 218 09:59:05,387 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 220 09:59:05,387 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 221 09:59:05,387 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 95 09:59:05,389 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 223 09:59:05,391 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 225 09:59:05,392 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 101 09:59:05,392 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 102 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 104 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 105 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 109 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 110 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 238 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 112 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 114 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 246 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 121 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 250 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 123 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 125 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 126 09:59:05,393 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 255 09:59:05,393 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,393 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,393 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,393 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,394 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,394 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:59:05,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:59:05,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:59:05,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:59:05,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:59:05,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:59:05,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:59:05,394 TRACE (ForkThread-1,Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:05,394 TRACE (ForkThread-1,Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:59:05,394 TRACE (ForkThread-1,Test:[]) [CacheNotifierImpl] Listener 40262d12-abe7-43af-8738-c7d1de71f5bc initial state for cache completed 09:59:05,394 DEBUG (ForkThread-1,Test:[]) [Test] Exiting fork callable. 09:59:05,394 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@4d6cb7e6[Not completed] to self 09:59:05,396 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@707ce7b[Not completed] to remote execution at node Test-NodeB-10318 09:59:05,396 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f9d879a] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,396 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f9d879a], mode=SYNCHRONOUS, timeout=15000 09:59:05,396 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f9d879a] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:05,396 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91938] on Test-NodeB-10318 09:59:05,396 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #178, conn_id=1) 09:59:05,397 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91938, rsp_expected=true, UNICAST3: DATA, seqno=178, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,400 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@1ed21db[Not completed] to remote execution at node Test-NodeC-52778 09:59:05,400 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,401 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:59:05,401 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f9d879a] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,402 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f9d879a], mode=SYNCHRONOUS, timeout=15000 09:59:05,402 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91938, rsp_expected=true, UNICAST3: DATA, seqno=178, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,402 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f9d879a] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:05,402 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #178, conn_id=1) 09:59:05,402 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#178 09:59:05,402 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91938 09:59:05,402 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91941] on Test-NodeC-52778 09:59:05,402 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #308, conn_id=2) 09:59:05,402 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91941, rsp_expected=true, UNICAST3: DATA, seqno=308, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,402 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (213 bytes (1065.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,404 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (216 bytes) 09:59:05,402 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@c173cb2] [sender=Test-NodeA-7051] 09:59:05,404 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:05,404 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,404 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91941, rsp_expected=true, UNICAST3: DATA, seqno=308, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,404 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #308, conn_id=2) 09:59:05,404 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#308 09:59:05,404 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91941 09:59:05,404 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7eb1d00a] [sender=Test-NodeA-7051] 09:59:05,404 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:05,404 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,405 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7eb1d00a] 09:59:05,405 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 40262d12-abe7-43af-8738-c7d1de71f5bc 09:59:05,405 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7eb1d00a] 09:59:05,405 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91941 to Test-NodeA-7051 09:59:05,405 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #311, conn_id=0) 09:59:05,405 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91941, rsp_expected=true, UNICAST3: DATA, seqno=311, TP: [cluster_name=ISPN] 09:59:05,408 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,408 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:05,404 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@c173cb2] 09:59:05,408 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 40262d12-abe7-43af-8738-c7d1de71f5bc 09:59:05,409 TRACE (OOB-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91941, rsp_expected=true, UNICAST3: DATA, seqno=311, TP: [cluster_name=ISPN] 09:59:05,408 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@c173cb2] 09:59:05,410 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91938 to Test-NodeA-7051 09:59:05,410 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #180, conn_id=0) 09:59:05,410 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #311, conn_id=0) 09:59:05,411 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91938, rsp_expected=true, UNICAST3: DATA, seqno=180, TP: [cluster_name=ISPN] 09:59:05,420 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,422 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:05,420 TRACE (OOB-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#311 09:59:05,422 TRACE (OOB-1,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,422 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91938, rsp_expected=true, UNICAST3: DATA, seqno=180, TP: [cluster_name=ISPN] 09:59:05,422 TRACE (OOB-1,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f9d879a] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:05,425 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #180, conn_id=0) 09:59:05,427 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#180 09:59:05,427 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,429 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@6f9d879a] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:05,429 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain size: 8 09:59:05,429 DEBUG (testng-Test:[]) [AsyncInterceptorChainImpl] Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@5169c490 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@53adc140 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@6a4ed0ff >> org.infinispan.statetransfer.StateTransferInterceptor@5743b57 >> org.infinispan.interceptors.locking.NonTransactionalLockingInterceptor@1a26322d >> org.infinispan.interceptors.impl.EntryWrappingInterceptor@273c57e8 >> org.infinispan.interceptors.distribution.NonTxDistributionInterceptor@3b69a2d8 >> org.infinispan.interceptors.impl.CallInterceptor@1f638861 09:59:05,430 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testRemoveAfterIterationBeganButNotIteratedValueYetOwnerClustered 09:59:05,431 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:59:05,431 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:59:05,432 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:59:05,432 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:59:05,433 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:05,433 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:59:05,433 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:59:05,433 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:05,434 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:59:05,434 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:59:05,434 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:05,434 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:59:05,435 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup createBeforeMethod 09:59:05,435 DEBUG (testng-Test:[]) [TestNGTestListener] After setup createBeforeMethod 09:59:05,437 INFO (testng-Test:[]) [TestSuiteProgress] Test starting: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testSimpleCacheStartingClusterListener 09:59:05,440 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1ef93a5a] 09:59:05,441 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:05,441 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-0'? false 09:59:05,442 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:05,442 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? false 09:59:05,442 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,443 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,443 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:05,443 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,444 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,446 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:05,446 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91953] on Test-NodeB-10318 09:59:05,455 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #179, conn_id=1) 09:59:05,455 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91953, rsp_expected=true, UNICAST3: DATA, seqno=179, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,455 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,455 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:05,457 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91953, rsp_expected=true, UNICAST3: DATA, seqno=179, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,462 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #179, conn_id=1) 09:59:05,462 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#179 09:59:05,462 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91953 09:59:05,462 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:05,462 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,462 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:38284. timeout=10000 (MILLISECONDS) 09:59:05,462 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38284. Timeout=10000 (MILLISECONDS) 09:59:05,463 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #74) 09:59:05,462 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38284} 09:59:05,463 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=74, conn_id=1, ts=104, TP: [cluster_name=ISPN] 09:59:05,464 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #308) 09:59:05,464 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=308, conn_id=2, ts=105, TP: [cluster_name=ISPN] 09:59:05,464 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,464 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:05,464 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38284}. Current=null 09:59:05,465 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,465 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:05,465 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=308, conn_id=2, ts=105, TP: [cluster_name=ISPN] 09:59:05,465 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #308, conn-id=2, ts=105) 09:59:05,466 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38284}) => true 09:59:05,466 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=74, conn_id=1, ts=104, TP: [cluster_name=ISPN] 09:59:05,467 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #74, conn-id=1, ts=104) 09:59:05,466 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38284}. WAITING => ACQUIRED 09:59:05,468 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38284} successfully acquired the lock. 09:59:05,468 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,468 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,468 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #179) 09:59:05,468 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@75c8116a] 09:59:05,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-0'? true 09:59:05,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-0 for owner=CommandInvocation:Test-NodeA-7051:38284. timeout=10000 (MILLISECONDS) 09:59:05,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38284. Timeout=10000 (MILLISECONDS) 09:59:05,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38284} 09:59:05,469 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=179, conn_id=1, ts=99, TP: [cluster_name=ISPN] 09:59:05,470 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #74) 09:59:05,470 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=74, conn_id=1, ts=100, TP: [cluster_name=ISPN] 09:59:05,475 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:59:05,475 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:05,475 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:05,475 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=74, conn_id=1, ts=100, TP: [cluster_name=ISPN] 09:59:05,475 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #74, conn-id=1, ts=100) 09:59:05,475 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=179, conn_id=1, ts=99, TP: [cluster_name=ISPN] 09:59:05,475 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #179, conn-id=1, ts=99) 09:59:05,469 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:05,476 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #180) 09:59:05,476 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=180, ts=116, TP: [cluster_name=ISPN] 09:59:05,477 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #311) 09:59:05,477 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=311, ts=117, TP: [cluster_name=ISPN] 09:59:05,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,475 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:59:05,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:05,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,477 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,477 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:05,479 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=180, ts=116, TP: [cluster_name=ISPN] 09:59:05,479 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=311, ts=117, TP: [cluster_name=ISPN] 09:59:05,479 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #311, conn-id=0, ts=117) 09:59:05,478 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,480 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:59:05,480 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(76dc039){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,480 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,479 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #180, conn-id=0, ts=116) 09:59:05,480 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,481 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,482 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,482 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:05,482 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=91960] on Test-NodeC-52778 09:59:05,483 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #75, conn_id=1) 09:59:05,483 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91960, rsp_expected=true, UNICAST3: DATA, seqno=75, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,483 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,483 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:59:05,483 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91960, rsp_expected=true, UNICAST3: DATA, seqno=75, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,484 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #75, conn_id=1) 09:59:05,484 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#75 09:59:05,484 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91960 09:59:05,484 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:05,484 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,484 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@314ae2cd] 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-0'? false 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-0'? true 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-0 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(54cd650a){key=key-0, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(54cd650a){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91960 to Test-NodeB-10318 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #75, conn_id=1) 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91960, rsp_expected=true, UNICAST3: DATA, seqno=75, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,484 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38284 09:59:05,490 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,490 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:05,491 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91960, rsp_expected=true, UNICAST3: DATA, seqno=75, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,492 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #75, conn_id=1) 09:59:05,492 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#75 09:59:05,493 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,493 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:05,493 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(76dc039){key=key-0, value=value-0, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,493 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-0. Operation Flag=null, L1 invalidation=false 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-0. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-0 removed=false valid=true changed=true created=true value=value-0 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-0 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-0, value=value-0} in container 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:38284 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38284. 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38284}. ACQUIRED => RELEASED 09:59:05,494 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38284}? true 09:59:05,495 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38284} 09:59:05,495 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38284}, null) => true 09:59:05,496 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:05,505 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,506 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91953 to Test-NodeA-7051 09:59:05,506 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #181, conn_id=0) 09:59:05,507 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91953, rsp_expected=true, UNICAST3: DATA, seqno=181, TP: [cluster_name=ISPN] 09:59:05,508 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-0]. owner=CommandInvocation:Test-NodeA-7051:38284 09:59:05,508 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,508 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:05,509 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91953, rsp_expected=true, UNICAST3: DATA, seqno=181, TP: [cluster_name=ISPN] 09:59:05,509 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #181, conn_id=0) 09:59:05,510 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#181 09:59:05,510 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,510 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-0, value=value-0, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:05,510 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,510 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21963c3e] 09:59:05,510 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:05,510 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:59:05,510 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:05,510 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? false 09:59:05,510 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,510 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,512 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:05,512 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,512 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,512 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:05,512 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91963] on Test-NodeC-52778 09:59:05,513 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #309, conn_id=2) 09:59:05,513 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91963, rsp_expected=true, UNICAST3: DATA, seqno=309, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,513 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,514 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:05,514 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91963, rsp_expected=true, UNICAST3: DATA, seqno=309, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,514 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #309, conn_id=2) 09:59:05,515 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#309 09:59:05,515 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91963 09:59:05,521 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:05,526 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,526 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:38291. timeout=10000 (MILLISECONDS) 09:59:05,531 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38291. Timeout=10000 (MILLISECONDS) 09:59:05,532 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38291} 09:59:05,532 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38291}. Current=null 09:59:05,533 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38291}) => true 09:59:05,533 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38291}. WAITING => ACQUIRED 09:59:05,533 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38291} successfully acquired the lock. 09:59:05,533 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,533 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,533 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,533 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@22410335] 09:59:05,533 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,533 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-1'? true 09:59:05,533 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-1 for owner=CommandInvocation:Test-NodeA-7051:38291. timeout=10000 (MILLISECONDS) 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38291. Timeout=10000 (MILLISECONDS) 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38291} 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(55619f23){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91972] on Test-NodeA-7051 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #312, conn_id=0) 09:59:05,534 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91972, rsp_expected=true, UNICAST3: DATA, seqno=312, TP: [cluster_name=ISPN] 09:59:05,534 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,536 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:05,538 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91972, rsp_expected=true, UNICAST3: DATA, seqno=312, TP: [cluster_name=ISPN] 09:59:05,538 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #312, conn_id=0) 09:59:05,538 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#312 09:59:05,538 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91972 09:59:05,538 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:05,538 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,538 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@1d393db9] 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-1'? false 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-1'? true 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-1 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(40977a47){key=key-1, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(40977a47){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:59:05,538 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:59:05,539 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,540 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,540 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 91972 to Test-NodeC-52778 09:59:05,540 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #310, conn_id=2) 09:59:05,544 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91972, rsp_expected=true, UNICAST3: DATA, seqno=310, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,544 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38291 09:59:05,544 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,544 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:05,545 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91972, rsp_expected=true, UNICAST3: DATA, seqno=310, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,545 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #310, conn_id=2) 09:59:05,545 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#310 09:59:05,553 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,562 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:05,564 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(55619f23){key=key-1, value=value-1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,564 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-1. Operation Flag=null, L1 invalidation=false 09:59:05,564 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-1. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,568 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-1 removed=false valid=true changed=true created=true value=value-1 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,568 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-1 09:59:05,568 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-1, value=value-1} in container 09:59:05,568 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,568 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:38291 09:59:05,568 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38291. 09:59:05,568 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38291}. ACQUIRED => RELEASED 09:59:05,570 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38291}? true 09:59:05,570 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38291} 09:59:05,573 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38291}, null) => true 09:59:05,573 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:05,573 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,574 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91963 to Test-NodeA-7051 09:59:05,574 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #313, conn_id=0) 09:59:05,574 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91963, rsp_expected=true, UNICAST3: DATA, seqno=313, TP: [cluster_name=ISPN] 09:59:05,576 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,576 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-1]. owner=CommandInvocation:Test-NodeA-7051:38291 09:59:05,576 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:05,577 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91963, rsp_expected=true, UNICAST3: DATA, seqno=313, TP: [cluster_name=ISPN] 09:59:05,577 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #313, conn_id=0) 09:59:05,577 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#313 09:59:05,578 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,579 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-1, value=value-1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:05,612 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,612 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2253851a] 09:59:05,612 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:05,621 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-2'? false 09:59:05,621 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:05,635 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? false 09:59:05,651 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,651 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,651 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:05,651 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,651 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,651 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:05,651 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=91988] on Test-NodeC-52778 09:59:05,651 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #311, conn_id=2) 09:59:05,651 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91988, rsp_expected=true, UNICAST3: DATA, seqno=311, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,651 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,651 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:05,651 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91988, rsp_expected=true, UNICAST3: DATA, seqno=311, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,651 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #311, conn_id=2) 09:59:05,651 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#311 09:59:05,651 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91988 09:59:05,651 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:05,651 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,651 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:38306. timeout=10000 (MILLISECONDS) 09:59:05,652 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38306. Timeout=10000 (MILLISECONDS) 09:59:05,652 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38306} 09:59:05,652 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38306}. Current=null 09:59:05,652 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38306}) => true 09:59:05,652 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38306}. WAITING => ACQUIRED 09:59:05,652 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38306} successfully acquired the lock. 09:59:05,652 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@16b37fff] 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-2'? true 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-2 for owner=CommandInvocation:Test-NodeA-7051:38306. timeout=10000 (MILLISECONDS) 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38306. Timeout=10000 (MILLISECONDS) 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38306} 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2bc1554c){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=91989] on Test-NodeB-10318 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #76, conn_id=1) 09:59:05,652 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91989, rsp_expected=true, UNICAST3: DATA, seqno=76, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,652 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,652 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:05,653 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=91989, rsp_expected=true, UNICAST3: DATA, seqno=76, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,653 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #76, conn_id=1) 09:59:05,653 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#76 09:59:05,653 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 91989 09:59:05,653 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:05,653 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,653 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@442da0d3] 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-2'? false 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-2'? true 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-2 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(352f2f20){key=key-2, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(352f2f20){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,653 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:59:05,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:59:05,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 91989 to Test-NodeC-52778 09:59:05,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #76, conn_id=1) 09:59:05,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91989, rsp_expected=true, UNICAST3: DATA, seqno=76, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,654 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38306 09:59:05,662 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,663 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:59:05,663 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91989, rsp_expected=true, UNICAST3: DATA, seqno=76, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,678 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #76, conn_id=1) 09:59:05,679 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#76 09:59:05,685 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,685 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:05,806 TRACE (Timer-3,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:05,806 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:05,806 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,806 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:59:05,807 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:05,807 TRACE (INT-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: handling digest from Test-NodeC-52778: mine: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] other: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] result: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:05,807 TRACE (INT-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:59:05,807 TRACE (INT-2,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:59:05,807 TRACE (INT-2,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 6 from Test-NodeA-7051 09:59:05,807 TRACE (INT-2,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 0 from Test-NodeB-10318 09:59:05,807 TRACE (INT-2,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: deleting msgs <= 0 from Test-NodeC-52778 09:59:05,811 TRACE (Timer-2,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: sending stability msg Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:05,811 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:05,811 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 09:59:05,811 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:05,811 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (120 bytes (600.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:59:05,811 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (123 bytes) 09:59:05,811 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:05,812 TRACE (INT-1,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: received stability msg from Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:05,812 TRACE (INT-1,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:59:05,812 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:59:05,812 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 6 from Test-NodeA-7051 09:59:05,812 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 0 from Test-NodeB-10318 09:59:05,812 TRACE (INT-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: deleting msgs <= 0 from Test-NodeC-52778 09:59:05,811 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (123 bytes) 09:59:05,813 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (2 headers), size=59 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [Test-NodeA-7051|2], TP: [cluster_name=ISPN] 09:59:05,813 TRACE (INT-2,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: received stability msg from Test-NodeA-7051: Test-NodeA-7051: [6], Test-NodeB-10318: [0], Test-NodeC-52778: [0] 09:59:05,813 TRACE (INT-2,Test-NodeC-52778:[]) [STABLE] Test-NodeC-52778: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1], Test-NodeC-52778: [-1] 09:59:05,813 TRACE (INT-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received stable digest Test-NodeA-7051: [6 (6)], Test-NodeB-10318: [0 (0)], Test-NodeC-52778: [0 (0)] 09:59:05,813 TRACE (INT-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 6 from Test-NodeA-7051 09:59:05,813 TRACE (INT-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 0 from Test-NodeB-10318 09:59:05,813 TRACE (INT-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: deleting msgs <= 0 from Test-NodeC-52778 09:59:05,789 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2bc1554c){key=key-2, value=value-2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,820 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-2. Operation Flag=null, L1 invalidation=false 09:59:05,822 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-2. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-2 removed=false valid=true changed=true created=true value=value-2 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-2 09:59:05,842 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-2, value=value-2} in container 09:59:05,842 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:38306 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38306. 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38306}. ACQUIRED => RELEASED 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38306}? true 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38306} 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38306}, null) => true 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 91988 to Test-NodeA-7051 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #314, conn_id=0) 09:59:05,852 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91988, rsp_expected=true, UNICAST3: DATA, seqno=314, TP: [cluster_name=ISPN] 09:59:05,853 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-2]. owner=CommandInvocation:Test-NodeA-7051:38306 09:59:05,853 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,853 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:05,854 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=91988, rsp_expected=true, UNICAST3: DATA, seqno=314, TP: [cluster_name=ISPN] 09:59:05,854 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #314, conn_id=0) 09:59:05,854 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#314 09:59:05,854 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,854 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-2, value=value-2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:05,856 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,856 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@36b942c2] 09:59:05,856 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:05,857 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-3'? false 09:59:05,857 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:05,857 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? false 09:59:05,857 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,857 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,857 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:05,857 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,857 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,857 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:05,857 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92010] on Test-NodeC-52778 09:59:05,857 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #312, conn_id=2) 09:59:05,857 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92010, rsp_expected=true, UNICAST3: DATA, seqno=312, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,858 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,858 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:05,858 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92010, rsp_expected=true, UNICAST3: DATA, seqno=312, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,859 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #312, conn_id=2) 09:59:05,859 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#312 09:59:05,859 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92010 09:59:05,859 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:38319. timeout=10000 (MILLISECONDS) 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38319. Timeout=10000 (MILLISECONDS) 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38319} 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38319}. Current=null 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38319}) => true 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38319}. WAITING => ACQUIRED 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38319} successfully acquired the lock. 09:59:05,891 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@5284eb02] 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-3'? true 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-3 for owner=CommandInvocation:Test-NodeA-7051:38319. timeout=10000 (MILLISECONDS) 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38319. Timeout=10000 (MILLISECONDS) 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38319} 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(d2891fb){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,892 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:05,893 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=92014] on Test-NodeB-10318 09:59:05,893 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #77, conn_id=1) 09:59:05,893 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92014, rsp_expected=true, UNICAST3: DATA, seqno=77, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,893 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,893 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:05,893 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92014, rsp_expected=true, UNICAST3: DATA, seqno=77, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,893 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #77, conn_id=1) 09:59:05,893 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#77 09:59:05,893 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92014 09:59:05,893 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:05,893 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,893 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@68165bd] 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-3'? false 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-3'? true 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,893 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-3 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(207523e0){key=key-3, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(207523e0){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 92014 to Test-NodeC-52778 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #77, conn_id=1) 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92014, rsp_expected=true, UNICAST3: DATA, seqno=77, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,894 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38319 09:59:05,894 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,894 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (81 bytes) 09:59:05,896 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92014, rsp_expected=true, UNICAST3: DATA, seqno=77, conn_id=1, TP: [cluster_name=ISPN] 09:59:05,897 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #77, conn_id=1) 09:59:05,897 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#77 09:59:05,897 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,897 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(d2891fb){key=key-3, value=value-3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-3. Operation Flag=null, L1 invalidation=false 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-3. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-3 removed=false valid=true changed=true created=true value=value-3 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-3 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-3, value=value-3} in container 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:38319 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38319. 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38319}. ACQUIRED => RELEASED 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38319}? true 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38319} 09:59:05,897 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38319}, null) => true 09:59:05,898 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:05,898 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,898 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92010 to Test-NodeA-7051 09:59:05,898 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #315, conn_id=0) 09:59:05,898 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92010, rsp_expected=true, UNICAST3: DATA, seqno=315, TP: [cluster_name=ISPN] 09:59:05,898 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-3]. owner=CommandInvocation:Test-NodeA-7051:38319 09:59:05,898 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,898 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:05,905 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92010, rsp_expected=true, UNICAST3: DATA, seqno=315, TP: [cluster_name=ISPN] 09:59:05,911 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #315, conn_id=0) 09:59:05,911 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#315 09:59:05,913 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,913 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-3, value=value-3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:05,914 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,914 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@bc04558] 09:59:05,914 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:05,914 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:59:05,914 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:05,914 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? false 09:59:05,914 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,914 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,914 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:05,914 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,914 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,914 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:05,914 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92017] on Test-NodeC-52778 09:59:05,914 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #313, conn_id=2) 09:59:05,914 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92017, rsp_expected=true, UNICAST3: DATA, seqno=313, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,914 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,914 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:05,914 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92017, rsp_expected=true, UNICAST3: DATA, seqno=313, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #313, conn_id=2) 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#313 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92017 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:38326. timeout=10000 (MILLISECONDS) 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38326. Timeout=10000 (MILLISECONDS) 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38326} 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38326}. Current=null 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38326}) => true 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38326}. WAITING => ACQUIRED 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38326} successfully acquired the lock. 09:59:05,933 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,933 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,933 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,933 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@6cef5925] 09:59:05,933 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,933 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-4'? true 09:59:05,943 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-4 for owner=CommandInvocation:Test-NodeA-7051:38326. timeout=10000 (MILLISECONDS) 09:59:05,943 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38326. Timeout=10000 (MILLISECONDS) 09:59:05,944 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38326} 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(1ea7a5ab){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:05,968 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #77) 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:05,968 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=77, conn_id=1, ts=106, TP: [cluster_name=ISPN] 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=92021] on Test-NodeA-7051 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #316, conn_id=0) 09:59:05,968 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:05,968 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:05,971 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=77, conn_id=1, ts=106, TP: [cluster_name=ISPN] 09:59:05,971 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #77, conn-id=1, ts=106) 09:59:05,968 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92021, rsp_expected=true, UNICAST3: DATA, seqno=316, TP: [cluster_name=ISPN] 09:59:05,968 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #313) 09:59:05,972 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=313, conn_id=2, ts=107, TP: [cluster_name=ISPN] 09:59:05,972 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (254 bytes (1270.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:05,972 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (213 bytes) 09:59:05,972 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92021, rsp_expected=true, UNICAST3: DATA, seqno=316, TP: [cluster_name=ISPN] 09:59:05,972 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #316, conn_id=0) 09:59:05,972 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#316 09:59:05,972 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92021 09:59:05,972 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:05,976 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #77) 09:59:05,977 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #181) 09:59:05,976 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=77, conn_id=1, ts=101, TP: [cluster_name=ISPN] 09:59:05,985 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,985 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:05,972 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:05,995 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:05,995 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,995 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:05,995 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@21ab0a08] 09:59:05,995 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-4'? false 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-4'? true 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-4 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2d02d524){key=key-4, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2d02d524){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 92021 to Test-NodeC-52778 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #314, conn_id=2) 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92021, rsp_expected=true, UNICAST3: DATA, seqno=314, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,996 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38326 09:59:05,996 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:05,996 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:05,996 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92021, rsp_expected=true, UNICAST3: DATA, seqno=314, conn_id=2, TP: [cluster_name=ISPN] 09:59:05,996 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #314, conn_id=2) 09:59:05,996 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#314 09:59:05,997 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:05,972 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received message batch of 1 messages from Test-NodeC-52778 09:59:05,997 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #313, conn-id=2, ts=107) 09:59:05,997 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:06,003 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(1ea7a5ab){key=key-4, value=value-4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,003 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-4. Operation Flag=null, L1 invalidation=false 09:59:06,003 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-4. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,003 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-4 removed=false valid=true changed=true created=true value=value-4 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-4 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-4, value=value-4} in container 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:38326 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38326. 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38326}. ACQUIRED => RELEASED 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38326}? true 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38326} 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38326}, null) => true 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92017 to Test-NodeA-7051 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #317, conn_id=0) 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92017, rsp_expected=true, UNICAST3: DATA, seqno=317, TP: [cluster_name=ISPN] 09:59:06,004 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-4]. owner=CommandInvocation:Test-NodeA-7051:38326 09:59:06,004 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,004 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:05,989 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=77, conn_id=1, ts=101, TP: [cluster_name=ISPN] 09:59:06,008 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #77, conn-id=1, ts=101) 09:59:05,982 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=181, ts=118, TP: [cluster_name=ISPN] 09:59:06,013 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #316) 09:59:06,013 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=316, ts=119, TP: [cluster_name=ISPN] 09:59:06,013 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (121 bytes (605.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:59:06,013 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:06,013 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:06,014 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=181, ts=118, TP: [cluster_name=ISPN] 09:59:06,014 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #181, conn-id=0, ts=118) 09:59:06,014 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=316, ts=119, TP: [cluster_name=ISPN] 09:59:06,014 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #316, conn-id=0, ts=119) 09:59:06,005 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92017, rsp_expected=true, UNICAST3: DATA, seqno=317, TP: [cluster_name=ISPN] 09:59:06,020 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #317, conn_id=0) 09:59:06,020 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#317 09:59:06,020 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,020 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-4, value=value-4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:06,020 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,021 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7284326f] 09:59:06,021 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:06,046 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-5'? true 09:59:06,046 TRACE (testng-Test:[]) [DefaultLockManager] Lock key=key-5 for owner=CommandInvocation:Test-NodeA-7051:38331. timeout=10000 (MILLISECONDS) 09:59:06,080 TRACE (testng-Test:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38331. Timeout=10000 (MILLISECONDS) 09:59:06,080 TRACE (testng-Test:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38331} 09:59:06,080 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38331}. Current=null 09:59:06,080 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38331}) => true 09:59:06,080 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38331}. WAITING => ACQUIRED 09:59:06,080 TRACE (testng-Test:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38331} successfully acquired the lock. 09:59:06,080 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=true 09:59:06,080 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:59:06,080 TRACE (testng-Test:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,127 TRACE (testng-Test:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,127 TRACE (testng-Test:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:59:06,127 TRACE (testng-Test:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(73ca1103){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,127 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,127 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,127 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm the primary owner, sending the command to all the backups ([Test-NodeA-7051, Test-NodeB-10318]) in order to be applied. 09:59:06,127 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeA-7051, Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,127 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051, Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,127 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:06,127 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92048] on Test-NodeB-10318 09:59:06,127 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #180, conn_id=1) 09:59:06,127 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92048, rsp_expected=true, UNICAST3: DATA, seqno=180, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,128 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:06,128 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:06,130 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92048, rsp_expected=true, UNICAST3: DATA, seqno=180, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,130 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #180, conn_id=1) 09:59:06,130 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#180 09:59:06,130 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92048 09:59:06,130 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:06,130 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,130 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@9f72405] 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-5'? false 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-5'? true 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-5 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(456d5c34){key=key-5, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(456d5c34){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 92048 to Test-NodeA-7051 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #182, conn_id=0) 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92048, rsp_expected=true, UNICAST3: DATA, seqno=182, TP: [cluster_name=ISPN] 09:59:06,131 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38331 09:59:06,132 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,132 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:06,136 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92048, rsp_expected=true, UNICAST3: DATA, seqno=182, TP: [cluster_name=ISPN] 09:59:06,136 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #182, conn_id=0) 09:59:06,136 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#182 09:59:06,136 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,136 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-5, value=value-5, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:06,136 TRACE (testng-Test:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(73ca1103){key=key-5, value=value-5, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,136 TRACE (testng-Test:[]) [CommitManager] Trying to commit. Key=key-5. Operation Flag=null, L1 invalidation=false 09:59:06,136 TRACE (testng-Test:[]) [CommitManager] Committing key=key-5. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,136 TRACE (testng-Test:[]) [ReadCommittedEntry] Updating entry (key=key-5 removed=false valid=true changed=true created=true value=value-5 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,136 TRACE (testng-Test:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-5 09:59:06,136 TRACE (testng-Test:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-5, value=value-5} in container 09:59:06,136 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,136 TRACE (testng-Test:[]) [DefaultLockManager] Release locks for keys=[key-5]. owner=CommandInvocation:Test-NodeA-7051:38331 09:59:06,136 TRACE (testng-Test:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38331. 09:59:06,136 TRACE (testng-Test:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38331}. ACQUIRED => RELEASED 09:59:06,136 TRACE (testng-Test:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38331}? true 09:59:06,136 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38331} 09:59:06,136 TRACE (testng-Test:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38331}, null) => true 09:59:06,136 TRACE (testng-Test:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:06,136 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@a6619d1] 09:59:06,136 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:06,136 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:59:06,136 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:06,161 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? false 09:59:06,161 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,161 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,161 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:06,161 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,161 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,161 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:06,161 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92051] on Test-NodeC-52778 09:59:06,161 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #315, conn_id=2) 09:59:06,161 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92051, rsp_expected=true, UNICAST3: DATA, seqno=315, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,161 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,161 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:06,163 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92051, rsp_expected=true, UNICAST3: DATA, seqno=315, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,163 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #315, conn_id=2) 09:59:06,190 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#315 09:59:06,190 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92051 09:59:06,190 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:06,190 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,190 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:38343. timeout=10000 (MILLISECONDS) 09:59:06,191 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38343. Timeout=10000 (MILLISECONDS) 09:59:06,191 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38343} 09:59:06,209 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38343}. Current=null 09:59:06,234 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38343}) => true 09:59:06,234 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38343}. WAITING => ACQUIRED 09:59:06,234 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38343} successfully acquired the lock. 09:59:06,234 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,234 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3d6d2c1d] 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-6'? true 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-6 for owner=CommandInvocation:Test-NodeA-7051:38343. timeout=10000 (MILLISECONDS) 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38343. Timeout=10000 (MILLISECONDS) 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38343} 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(12ebef00){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=92062] on Test-NodeA-7051 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #318, conn_id=0) 09:59:06,281 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92062, rsp_expected=true, UNICAST3: DATA, seqno=318, TP: [cluster_name=ISPN] 09:59:06,281 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,282 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:06,282 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92062, rsp_expected=true, UNICAST3: DATA, seqno=318, TP: [cluster_name=ISPN] 09:59:06,282 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #318, conn_id=0) 09:59:06,282 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#318 09:59:06,282 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92062 09:59:06,282 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:06,282 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,282 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7982f1c8] 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-6'? false 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-6'? true 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-6 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(23cf9fd){key=key-6, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(23cf9fd){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,282 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 92062 to Test-NodeC-52778 09:59:06,283 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #316, conn_id=2) 09:59:06,283 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92062, rsp_expected=true, UNICAST3: DATA, seqno=316, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,283 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38343 09:59:06,283 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,283 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:06,283 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92062, rsp_expected=true, UNICAST3: DATA, seqno=316, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,283 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #316, conn_id=2) 09:59:06,283 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#316 09:59:06,283 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,283 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(12ebef00){key=key-6, value=value-6, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-6. Operation Flag=null, L1 invalidation=false 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-6. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-6 removed=false valid=true changed=true created=true value=value-6 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-6 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-6, value=value-6} in container 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:38343 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38343. 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38343}. ACQUIRED => RELEASED 09:59:06,283 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38343}? true 09:59:06,286 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38343} 09:59:06,286 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38343}, null) => true 09:59:06,286 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:06,286 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,286 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92051 to Test-NodeA-7051 09:59:06,286 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #319, conn_id=0) 09:59:06,286 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92051, rsp_expected=true, UNICAST3: DATA, seqno=319, TP: [cluster_name=ISPN] 09:59:06,286 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-6]. owner=CommandInvocation:Test-NodeA-7051:38343 09:59:06,286 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,286 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:06,286 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92051, rsp_expected=true, UNICAST3: DATA, seqno=319, TP: [cluster_name=ISPN] 09:59:06,336 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #319, conn_id=0) 09:59:06,336 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#319 09:59:06,336 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,336 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-6, value=value-6, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:06,337 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,337 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4fcfb9a] 09:59:06,337 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:06,337 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:59:06,337 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:06,337 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? false 09:59:06,337 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,337 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,337 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:06,337 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,337 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,337 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:06,338 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92065] on Test-NodeC-52778 09:59:06,338 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #317, conn_id=2) 09:59:06,338 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92065, rsp_expected=true, UNICAST3: DATA, seqno=317, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,338 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,338 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:06,338 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92065, rsp_expected=true, UNICAST3: DATA, seqno=317, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,338 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #317, conn_id=2) 09:59:06,338 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#317 09:59:06,351 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92065 09:59:06,351 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:06,351 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,352 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:38367. timeout=10000 (MILLISECONDS) 09:59:06,352 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38367. Timeout=10000 (MILLISECONDS) 09:59:06,352 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38367} 09:59:06,352 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38367}. Current=null 09:59:06,352 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38367}) => true 09:59:06,352 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38367}. WAITING => ACQUIRED 09:59:06,352 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38367} successfully acquired the lock. 09:59:06,352 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@47c94e38] 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-7'? true 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-7 for owner=CommandInvocation:Test-NodeA-7051:38367. timeout=10000 (MILLISECONDS) 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38367. Timeout=10000 (MILLISECONDS) 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38367} 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2fb3eb81){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,357 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,358 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:06,358 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=92067] on Test-NodeA-7051 09:59:06,358 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #320, conn_id=0) 09:59:06,358 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92067, rsp_expected=true, UNICAST3: DATA, seqno=320, TP: [cluster_name=ISPN] 09:59:06,358 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,358 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:06,359 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92067, rsp_expected=true, UNICAST3: DATA, seqno=320, TP: [cluster_name=ISPN] 09:59:06,378 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #320, conn_id=0) 09:59:06,378 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#320 09:59:06,378 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92067 09:59:06,378 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:06,378 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,378 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7bbe58f8] 09:59:06,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,378 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-7'? false 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-7'? true 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-7 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(402e195e){key=key-7, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(402e195e){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 92067 to Test-NodeC-52778 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #318, conn_id=2) 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92067, rsp_expected=true, UNICAST3: DATA, seqno=318, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,379 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38367 09:59:06,379 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,379 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:06,381 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92067, rsp_expected=true, UNICAST3: DATA, seqno=318, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,381 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #318, conn_id=2) 09:59:06,382 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#318 09:59:06,382 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,382 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:06,382 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2fb3eb81){key=key-7, value=value-7, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,382 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-7. Operation Flag=null, L1 invalidation=false 09:59:06,382 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-7. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,382 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-7 removed=false valid=true changed=true created=true value=value-7 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,410 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-7 09:59:06,410 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-7, value=value-7} in container 09:59:06,410 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,410 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:38367 09:59:06,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38367. 09:59:06,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38367}. ACQUIRED => RELEASED 09:59:06,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38367}? true 09:59:06,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38367} 09:59:06,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38367}, null) => true 09:59:06,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:06,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,412 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92065 to Test-NodeA-7051 09:59:06,447 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #321, conn_id=0) 09:59:06,447 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92065, rsp_expected=true, UNICAST3: DATA, seqno=321, TP: [cluster_name=ISPN] 09:59:06,447 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-7]. owner=CommandInvocation:Test-NodeA-7051:38367 09:59:06,447 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,447 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:06,447 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92065, rsp_expected=true, UNICAST3: DATA, seqno=321, TP: [cluster_name=ISPN] 09:59:06,448 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #321, conn_id=0) 09:59:06,448 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#321 09:59:06,448 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,448 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-7, value=value-7, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:06,448 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,448 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@61c5cfa2] 09:59:06,448 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:06,448 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-8'? false 09:59:06,448 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=false,originalLocal=true 09:59:06,448 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? false 09:59:06,448 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,448 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,448 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeB-10318) in order to be forwarded 09:59:06,448 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,448 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,448 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:06,448 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92076] on Test-NodeB-10318 09:59:06,473 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #181, conn_id=1) 09:59:06,473 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92076, rsp_expected=true, UNICAST3: DATA, seqno=181, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,473 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:06,473 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (195 bytes) 09:59:06,475 TRACE (Timer-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #318) 09:59:06,475 TRACE (Timer-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=318, conn_id=2, ts=108, TP: [cluster_name=ISPN] 09:59:06,475 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,475 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:06,476 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=318, conn_id=2, ts=108, TP: [cluster_name=ISPN] 09:59:06,476 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #318, conn-id=2, ts=108) 09:59:06,485 TRACE (Timer-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #180) 09:59:06,485 TRACE (Timer-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=180, conn_id=1, ts=102, TP: [cluster_name=ISPN] 09:59:06,485 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,486 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:06,486 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=180, conn_id=1, ts=102, TP: [cluster_name=ISPN] 09:59:06,486 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #180, conn-id=1, ts=102) 09:59:06,473 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92076, rsp_expected=true, UNICAST3: DATA, seqno=181, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #181, conn_id=1) 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#181 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92076 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:38376. timeout=10000 (MILLISECONDS) 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38376. Timeout=10000 (MILLISECONDS) 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38376} 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38376}. Current=null 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38376}) => true 09:59:06,513 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #182) 09:59:06,513 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=182, ts=120, TP: [cluster_name=ISPN] 09:59:06,513 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #321) 09:59:06,513 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=321, ts=121, TP: [cluster_name=ISPN] 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38376}. WAITING => ACQUIRED 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38376} successfully acquired the lock. 09:59:06,513 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@484c65a9] 09:59:06,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeB-10318) we the lock owners for key 'key-8'? true 09:59:06,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Lock key=key-8 for owner=CommandInvocation:Test-NodeA-7051:38376. timeout=10000 (MILLISECONDS) 09:59:06,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38376. Timeout=10000 (MILLISECONDS) 09:59:06,513 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38376} 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(412f2563){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeB-10318, Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeB-10318, Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=92082] on Test-NodeC-52778 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #78, conn_id=1) 09:59:06,514 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92082, rsp_expected=true, UNICAST3: DATA, seqno=78, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,514 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (192 bytes (960.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,514 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (195 bytes) 09:59:06,514 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92082, rsp_expected=true, UNICAST3: DATA, seqno=78, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,524 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #78, conn_id=1) 09:59:06,524 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#78 09:59:06,524 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92082 09:59:06,524 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeB-10318] 09:59:06,524 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,524 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,513 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:06,524 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:06,525 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,525 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:06,527 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=182, ts=120, TP: [cluster_name=ISPN] 09:59:06,527 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #182, conn-id=0, ts=120) 09:59:06,528 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=321, ts=121, TP: [cluster_name=ISPN] 09:59:06,528 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #321, conn-id=0, ts=121) 09:59:06,524 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,533 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@74094e08] 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-8'? false 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-8'? true 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-8 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(89c6f0a){key=key-8, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(89c6f0a){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92082 to Test-NodeB-10318 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #78, conn_id=1) 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92082, rsp_expected=true, UNICAST3: DATA, seqno=78, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,563 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38376 09:59:06,564 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:06,564 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:06,565 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92082, rsp_expected=true, UNICAST3: DATA, seqno=78, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,565 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #78, conn_id=1) 09:59:06,565 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#78 09:59:06,565 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,565 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:06,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(412f2563){key=key-8, value=value-8, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Trying to commit. Key=key-8. Operation Flag=null, L1 invalidation=false 09:59:06,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommitManager] Committing key=key-8. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ReadCommittedEntry] Updating entry (key=key-8 removed=false valid=true changed=true created=true value=value-8 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-8 09:59:06,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-8, value=value-8} in container 09:59:06,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,582 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:38376 09:59:06,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38376. 09:59:06,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38376}. ACQUIRED => RELEASED 09:59:06,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38376}? true 09:59:06,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38376} 09:59:06,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38376}, null) => true 09:59:06,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:06,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,587 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 92076 to Test-NodeA-7051 09:59:06,588 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #183, conn_id=0) 09:59:06,588 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92076, rsp_expected=true, UNICAST3: DATA, seqno=183, TP: [cluster_name=ISPN] 09:59:06,588 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [DefaultLockManager] Release locks for keys=[key-8]. owner=CommandInvocation:Test-NodeA-7051:38376 09:59:06,588 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,590 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:06,590 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92076, rsp_expected=true, UNICAST3: DATA, seqno=183, TP: [cluster_name=ISPN] 09:59:06,590 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #183, conn_id=0) 09:59:06,590 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#183 09:59:06,590 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,599 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-8, value=value-8, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:06,604 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,604 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4c1c605e] 09:59:06,604 TRACE (testng-Test:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id -1 09:59:06,604 TRACE (testng-Test:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:59:06,604 TRACE (testng-Test:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=true 09:59:06,604 TRACE (testng-Test:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? false 09:59:06,604 TRACE (testng-Test:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,604 TRACE (testng-Test:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,604 TRACE (testng-Test:[]) [BaseDistributionInterceptor] I'm not the primary owner, so sending the command to the primary owner(Test-NodeC-52778) in order to be forwarded 09:59:06,604 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,605 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,605 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:06,605 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92093] on Test-NodeC-52778 09:59:06,605 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #319, conn_id=2) 09:59:06,605 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92093, rsp_expected=true, UNICAST3: DATA, seqno=319, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,605 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,605 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (196 bytes) 09:59:06,606 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92093, rsp_expected=true, UNICAST3: DATA, seqno=319, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,606 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #319, conn_id=2) 09:59:06,606 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#319 09:59:06,606 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92093 09:59:06,615 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeA-7051] 09:59:06,615 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,633 TRACE (OOB-2,Test-NodeC-52778:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:38394. timeout=10000 (MILLISECONDS) 09:59:06,633 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38394. Timeout=10000 (MILLISECONDS) 09:59:06,633 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Created a new one: LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38394} 09:59:06,645 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38394}. Current=null 09:59:06,646 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=CommandInvocation:Test-NodeA-7051:38394}) => true 09:59:06,646 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38394}. WAITING => ACQUIRED 09:59:06,646 TRACE (OOB-2,Test-NodeC-52778:[]) [InfinispanLock] LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38394} successfully acquired the lock. 09:59:06,646 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@3c7a6e1f] 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeC-52778) we the lock owners for key 'key-9'? true 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Lock key=key-9 for owner=CommandInvocation:Test-NodeA-7051:38394. timeout=10000 (MILLISECONDS) 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Acquire lock for CommandInvocation:Test-NodeA-7051:38394. Timeout=10000 (MILLISECONDS) 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=CommandInvocation:Test-NodeA-7051:38394} 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] isPrimary=true,isOwner=true,originalLocal=false 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(2f81c18){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} to recipient list [Test-NodeC-52778, Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeC-52778, Test-NodeA-7051], command=SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}}, mode=SYNCHRONOUS, timeout=15000 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=92098] on Test-NodeA-7051 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #322, conn_id=0) 09:59:06,646 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92098, rsp_expected=true, UNICAST3: DATA, seqno=322, TP: [cluster_name=ISPN] 09:59:06,646 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (193 bytes (965.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,660 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (196 bytes) 09:59:06,660 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=118 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92098, rsp_expected=true, UNICAST3: DATA, seqno=322, TP: [cluster_name=ISPN] 09:59:06,660 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #322, conn_id=0) 09:59:06,660 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#322 09:59:06,660 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92098 09:59:06,660 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} [sender=Test-NodeC-52778] 09:59:06,660 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,660 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseRpcInvokingCommand] Invoking command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, with originLocal flag set to false 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2e4cbc22] 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [StateTransferInterceptor] handleNonTxWriteCommand for command PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, topology id 5 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTransactionalLockingInterceptor] Are (Test-NodeA-7051) we the lock owners for key 'key-9'? false 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] isPrimary=false,isOwner=true,originalLocal=false 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] Wrapping entry 'key-9'? true 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Exists in context? null 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Retrieved from container null (ignoreOwnership=false, isLocal=true) 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Creating new entry for key key-9 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryFactoryImpl] Updated context entry ReadCommittedEntry(4bda4b07){key=key-9, value=null, oldValue=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=null} 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CallInterceptor] Invoking: PutKeyValueCommand 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [BaseDistributionInterceptor] Command topology id is 5, current topology id is 5, successful? true 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(4bda4b07){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,660 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:59:06,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:59:06,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 92098 to Test-NodeC-52778 09:59:06,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #320, conn_id=2) 09:59:06,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92098, rsp_expected=true, UNICAST3: DATA, seqno=320, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,661 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DefaultLockManager] Release locks for keys=[]. owner=CommandInvocation:Test-NodeA-7051:38394 09:59:06,661 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,661 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:06,661 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92098, rsp_expected=true, UNICAST3: DATA, seqno=320, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,662 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #320, conn_id=2) 09:59:06,662 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#320 09:59:06,662 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,662 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2f81c18){key=key-9, value=value-9, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipRemoteGet=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Trying to commit. Key=key-9. Operation Flag=null, L1 invalidation=false 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommitManager] Committing key=key-9. It is a L1 invalidation or a normal put and no tracking is enabled! 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ReadCommittedEntry] Updating entry (key=key-9 removed=false valid=true changed=true created=true value=value-9 metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, providedMetadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}) 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=value-9 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultDataContainer] Store ImmortalCacheEntry{key=key-9, value=value-9} in container 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:38394 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for CommandInvocation:Test-NodeA-7051:38394. 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] State changed for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38394}. ACQUIRED => RELEASED 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Release lock for LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38394}? true 09:59:06,662 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38394} 09:59:06,663 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=CommandInvocation:Test-NodeA-7051:38394}, null) => true 09:59:06,663 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InfinispanLock] Try acquire. Next in queue=null. Current=null 09:59:06,663 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command SingleRpcCommand{cacheName='DistInitialTransferListener', command=PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}} 09:59:06,663 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92093 to Test-NodeA-7051 09:59:06,663 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #323, conn_id=0) 09:59:06,663 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92093, rsp_expected=true, UNICAST3: DATA, seqno=323, TP: [cluster_name=ISPN] 09:59:06,663 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [DefaultLockManager] Release locks for keys=[key-9]. owner=CommandInvocation:Test-NodeA-7051:38394 09:59:06,663 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,663 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:06,663 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92093, rsp_expected=true, UNICAST3: DATA, seqno=323, TP: [cluster_name=ISPN] 09:59:06,668 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #323, conn_id=0) 09:59:06,668 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#323 09:59:06,668 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,668 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to PutKeyValueCommand{key=key-9, value=value-9, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:06,668 TRACE (testng-Test:[]) [EntryWrappingInterceptor] The return value is null 09:59:06,668 TRACE (testng-Test:[]) [CacheNotifierImpl] Replicating cluster listener to other nodes [Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778] for cluster listener with id 595e9e4b-b93e-48aa-82c7-ad621f55d287 09:59:06,668 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@21bdc4c1[Not completed] to remote execution at node Test-NodeB-10318 09:59:06,668 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@59445adf] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,669 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@59445adf], mode=SYNCHRONOUS, timeout=15000 09:59:06,669 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@59445adf] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:06,669 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92100] on Test-NodeB-10318 09:59:06,669 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #182, conn_id=1) 09:59:06,669 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92100, rsp_expected=true, UNICAST3: DATA, seqno=182, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,669 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@73c8556b[Not completed] to remote execution at node Test-NodeC-52778 09:59:06,669 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@59445adf] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,669 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@59445adf], mode=SYNCHRONOUS, timeout=15000 09:59:06,669 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@59445adf] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:06,669 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92101] on Test-NodeC-52778 09:59:06,669 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #321, conn_id=2) 09:59:06,669 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92101, rsp_expected=true, UNICAST3: DATA, seqno=321, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,669 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 2 msgs (473 bytes (2365.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeB-10318] 09:59:06,681 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (240 bytes) 09:59:06,682 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92101, rsp_expected=true, UNICAST3: DATA, seqno=321, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,682 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #321, conn_id=2) 09:59:06,682 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#321 09:59:06,682 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92101 09:59:06,682 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@639d2633] [sender=Test-NodeA-7051] 09:59:06,682 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:06,682 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,682 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@639d2633] 09:59:06,682 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 595e9e4b-b93e-48aa-82c7-ad621f55d287 09:59:06,683 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@639d2633] 09:59:06,683 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92101 to Test-NodeA-7051 09:59:06,683 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #324, conn_id=0) 09:59:06,683 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92101, rsp_expected=true, UNICAST3: DATA, seqno=324, TP: [cluster_name=ISPN] 09:59:06,683 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,683 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:06,683 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92101, rsp_expected=true, UNICAST3: DATA, seqno=324, TP: [cluster_name=ISPN] 09:59:06,683 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #324, conn_id=0) 09:59:06,683 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#324 09:59:06,683 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,683 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@59445adf] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:06,682 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (239 bytes) 09:59:06,685 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=162 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92100, rsp_expected=true, UNICAST3: DATA, seqno=182, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,711 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #182, conn_id=1) 09:59:06,711 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#182 09:59:06,711 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92100 09:59:06,711 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4ef09b4a] [sender=Test-NodeA-7051] 09:59:06,711 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:06,711 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,711 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4ef09b4a] 09:59:06,716 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerReplicateCallable] Registered local cluster listener for remote cluster listener from origin Test-NodeA-7051 with id 595e9e4b-b93e-48aa-82c7-ad621f55d287 09:59:06,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@4ef09b4a] 09:59:06,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 92100 to Test-NodeA-7051 09:59:06,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #184, conn_id=0) 09:59:06,717 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92100, rsp_expected=true, UNICAST3: DATA, seqno=184, TP: [cluster_name=ISPN] 09:59:06,724 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,745 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:06,745 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92100, rsp_expected=true, UNICAST3: DATA, seqno=184, TP: [cluster_name=ISPN] 09:59:06,745 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #184, conn_id=0) 09:59:06,745 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#184 09:59:06,745 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,745 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerReplicateCallable@59445adf] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:06,746 TRACE (testng-Test:[]) [CacheNotifierImpl] Listener 595e9e4b-b93e-48aa-82c7-ad621f55d287 requests initial state for cache 09:59:06,746 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@54fafd86] 09:59:06,746 TRACE (testng-Test:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:06,755 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Thread Thread[testng-Test,5,main] submitted iterator request for stream 09:59:06,764 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Performing remote rehash key aware operations {Test-NodeB-10318=[0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127], Test-NodeC-52778=[129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253]} for id Test-NodeA-705118 09:59:06,764 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeB-10318 for Test-NodeA-705118 excluding keys [] 09:59:06,774 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,774 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:59:06,781 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:06,781 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:06,793 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92115] on Test-NodeB-10318 09:59:06,798 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #183, conn_id=1) 09:59:06,798 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92115, rsp_expected=true, UNICAST3: DATA, seqno=183, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,798 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (652 bytes (3260.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:06,798 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (655 bytes) 09:59:06,812 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=578 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92115, rsp_expected=true, UNICAST3: DATA, seqno=183, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,824 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #183, conn_id=1) 09:59:06,824 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#183 09:59:06,824 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92115 09:59:06,824 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:59:06,825 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,825 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,825 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:06,825 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705118 from Test-NodeA-7051 for segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:06,825 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@79fdcc53] 09:59:06,825 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:06,825 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705118 09:59:06,825 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705118 09:59:06,825 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705118 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [EntryStreamSupplier] Applying segment filter [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] Request Test-NodeA-705118 completed segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] with [] suspected segments 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705118 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=92120] on Test-NodeA-7051 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #185, conn_id=0) 09:59:06,826 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92120, rsp_expected=true, UNICAST3: DATA, seqno=185, TP: [cluster_name=ISPN] 09:59:06,827 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (225 bytes (1125.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,827 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (228 bytes) 09:59:06,828 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=151 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92120, rsp_expected=true, UNICAST3: DATA, seqno=185, TP: [cluster_name=ISPN] 09:59:06,828 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #185, conn_id=0) 09:59:06,828 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#185 09:59:06,828 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92120 09:59:06,831 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeB-10318] 09:59:06,836 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:06,836 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,836 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:06,836 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeB-10318 with a completed response true for id Test-NodeA-705118 with [] suspected segments. 09:59:06,837 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [0, 1, 6, 136, 137, 138, 11, 142, 144, 17, 149, 150, 152, 26, 154, 27, 155, 156, 29, 157, 32, 160, 33, 161, 34, 36, 165, 38, 39, 168, 42, 44, 46, 177, 178, 52, 53, 54, 182, 55, 183, 184, 57, 186, 59, 64, 65, 193, 194, 198, 202, 75, 204, 77, 206, 207, 80, 208, 209, 211, 84, 87, 88, 216, 217, 91, 92, 97, 226, 100, 230, 231, 232, 106, 234, 235, 237, 111, 242, 115, 243, 116, 244, 117, 247, 248, 251, 252, 254, 127] 09:59:06,837 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeB-10318 with results 2 09:59:06,837 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:06,837 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 92120 to Test-NodeB-10318 09:59:06,837 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #184, conn_id=1) 09:59:06,837 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92120, rsp_expected=true, UNICAST3: DATA, seqno=184, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,837 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:06,837 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (79 bytes) 09:59:06,837 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92120, rsp_expected=true, UNICAST3: DATA, seqno=184, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,839 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #184, conn_id=1) 09:59:06,839 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#184 09:59:06,839 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:59:06,839 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:06,839 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:06,839 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 92115 to Test-NodeA-7051 09:59:06,839 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #186, conn_id=0) 09:59:06,839 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92115, rsp_expected=true, UNICAST3: DATA, seqno=186, TP: [cluster_name=ISPN] 09:59:06,839 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,839 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (79 bytes) 09:59:06,839 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92115, rsp_expected=true, UNICAST3: DATA, seqno=186, TP: [cluster_name=ISPN] 09:59:06,839 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #186, conn_id=0) 09:59:06,839 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#186 09:59:06,839 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318, received=true, suspected=false 09:59:06,839 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:06,840 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Submitting task to Test-NodeC-52778 for Test-NodeA-705118 excluding keys [] 09:59:06,840 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Test-NodeA-7051 invoking StreamRequestCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,840 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RpcManagerImpl] Topology id missing on command StreamRequestCommand{cacheName='DistInitialTransferListener'}, setting it to 5 09:59:06,840 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StreamRequestCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:06,840 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StreamRequestCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:06,840 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92121] on Test-NodeC-52778 09:59:06,840 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #322, conn_id=2) 09:59:06,840 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92121, rsp_expected=true, UNICAST3: DATA, seqno=322, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,840 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (608 bytes (3040.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,840 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (611 bytes) 09:59:06,840 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=533 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92121, rsp_expected=true, UNICAST3: DATA, seqno=322, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,840 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #322, conn_id=2) 09:59:06,840 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#322 09:59:06,840 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92121 09:59:06,840 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamRequestCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeA-7051] 09:59:06,841 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 5, current topology is 5 09:59:06,841 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:06,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Received key rehash aware operation request for id Test-NodeA-705118 from Test-NodeA-7051 for segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:06,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [InvocationContextInterceptor] Invoked with command EntrySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@6f70ccc8] 09:59:06,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CallInterceptor] Invoking: EntrySetCommand 09:59:06,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Registered change listener for Test-NodeA-705118 09:59:06,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Topology for supplier is CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[38905a8b-122f-4ec5-822a-b8b876c300bd, d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} for id Test-NodeA-705118 09:59:06,841 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Hash PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[Test-NodeA-7051: 85+76, Test-NodeB-10318: 90+96, Test-NodeC-52778: 81+84]} for id Test-NodeA-705118 09:59:06,842 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [EntryStreamSupplier] Applying segment filter [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:06,842 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] Request Test-NodeA-705118 completed segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] with [] suspected segments 09:59:06,843 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [LocalStreamManagerImpl] UnRegistered change listener for Test-NodeA-705118 09:59:06,843 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StreamResponseCommand{cacheName='DistInitialTransferListener'} to recipient list [Test-NodeA-7051] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,843 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=StreamResponseCommand{cacheName='DistInitialTransferListener'}, mode=SYNCHRONOUS, timeout=15000 09:59:06,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] Replication task sending StreamResponseCommand{cacheName='DistInitialTransferListener'} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:06,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=92122] on Test-NodeA-7051 09:59:06,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #325, conn_id=0) 09:59:06,844 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92122, rsp_expected=true, UNICAST3: DATA, seqno=325, TP: [cluster_name=ISPN] 09:59:06,844 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (316 bytes (1580.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,844 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (319 bytes) 09:59:06,847 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=241 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92122, rsp_expected=true, UNICAST3: DATA, seqno=325, TP: [cluster_name=ISPN] 09:59:06,847 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #325, conn_id=0) 09:59:06,847 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#325 09:59:06,847 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92122 09:59:06,847 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StreamResponseCommand{cacheName='DistInitialTransferListener'} [sender=Test-NodeC-52778] 09:59:06,847 TRACE (OOB-2,Test-NodeA-7051:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:06,847 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,847 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:06,848 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Received response from Test-NodeC-52778 with a completed response true for id Test-NodeA-705118 with [] suspected segments. 09:59:06,848 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [129, 2, 130, 131, 4, 132, 133, 135, 8, 10, 139, 14, 15, 16, 18, 19, 147, 148, 21, 151, 153, 30, 158, 31, 159, 164, 40, 41, 45, 47, 48, 180, 181, 60, 63, 67, 195, 69, 71, 72, 201, 74, 203, 76, 205, 78, 81, 82, 210, 83, 85, 86, 90, 219, 93, 94, 222, 96, 224, 98, 99, 227, 228, 229, 103, 233, 107, 108, 236, 239, 240, 113, 241, 245, 118, 119, 120, 249, 122, 124, 253] 09:59:06,848 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from Test-NodeC-52778 with results 7 09:59:06,848 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [ClusterStreamManagerImpl] Marking Test-NodeA-705118 as completed! 09:59:06,848 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamResponseCommand{cacheName='DistInitialTransferListener'} 09:59:06,848 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 92122 to Test-NodeC-52778 09:59:06,848 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #323, conn_id=2) 09:59:06,848 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92122, rsp_expected=true, UNICAST3: DATA, seqno=323, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,849 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,849 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (80 bytes) 09:59:06,849 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92122, rsp_expected=true, UNICAST3: DATA, seqno=323, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,849 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #323, conn_id=2) 09:59:06,849 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#323 09:59:06,850 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051, received=true, suspected=false 09:59:06,850 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StreamResponseCommand{cacheName='DistInitialTransferListener'} is {Test-NodeA-7051=SuccessfulResponse{responseValue=null} } 09:59:06,850 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response null for command StreamRequestCommand{cacheName='DistInitialTransferListener'} 09:59:06,850 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92121 to Test-NodeA-7051 09:59:06,850 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #326, conn_id=0) 09:59:06,850 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92121, rsp_expected=true, UNICAST3: DATA, seqno=326, TP: [cluster_name=ISPN] 09:59:06,854 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,854 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (80 bytes) 09:59:06,854 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92121, rsp_expected=true, UNICAST3: DATA, seqno=326, TP: [cluster_name=ISPN] 09:59:06,854 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #326, conn_id=0) 09:59:06,854 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#326 09:59:06,854 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778, received=true, suspected=false 09:59:06,854 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to StreamRequestCommand{cacheName='DistInitialTransferListener'} is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:06,855 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [EntryStreamSupplier] Applying segment filter [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:06,855 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-0, value=value-0, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,856 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 129 09:59:06,856 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Found local values 1 for id Test-NodeA-705118 09:59:06,856 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Completing segments [128, 3, 5, 134, 7, 9, 12, 140, 13, 141, 143, 145, 146, 20, 22, 23, 24, 25, 28, 162, 35, 163, 37, 166, 167, 169, 170, 43, 171, 172, 173, 174, 175, 176, 49, 50, 51, 179, 56, 185, 58, 187, 188, 61, 189, 62, 190, 191, 192, 66, 68, 196, 197, 70, 199, 200, 73, 79, 212, 213, 214, 215, 89, 218, 220, 221, 95, 223, 225, 101, 102, 104, 105, 109, 110, 238, 112, 114, 246, 121, 250, 123, 125, 126, 255] 09:59:06,856 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Response from null with results 1 09:59:06,856 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 130 09:59:06,857 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 131 09:59:06,857 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 4 09:59:06,857 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Awaiting completion of Test-NodeA-705118 09:59:06,918 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [ClusterStreamManagerImpl] Returning back to caller due to Test-NodeA-705118 being completed: true 09:59:06,918 TRACE (async-thread-Test-NodeA-p23741-t3:[]) [DistributionBulkInterceptor$BackingEntrySet$1] Finished rehash aware operation for Test-NodeA-705118 09:59:06,914 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 132 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 133 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 135 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 8 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 10 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 139 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 14 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 15 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 16 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 18 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 19 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 147 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 148 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 21 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 151 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 153 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 30 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 158 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 31 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 159 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 164 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 40 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 41 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 45 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 47 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 180 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 181 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 60 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 63 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 67 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 195 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 69 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 201 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 74 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 203 09:59:06,932 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 76 09:59:06,939 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 205 09:59:06,940 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 78 09:59:06,940 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 81 09:59:06,940 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 82 09:59:06,941 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 210 09:59:06,941 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 83 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 85 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 86 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 90 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 219 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 93 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 94 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 222 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 96 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 224 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 98 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 99 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 227 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 228 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 103 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 107 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 108 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 236 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 239 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 240 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 113 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 241 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 245 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 119 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 120 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 249 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 122 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 124 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 253 09:59:06,942 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-8, value=value-8, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 244 09:59:06,942 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 251 09:59:06,943 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-1, value=value-1, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,943 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-4, value=value-4, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,943 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-3, value=value-3, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,943 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-2, value=value-2, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,943 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-9, value=value-9, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,943 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-7, value=value-7, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,944 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-6, value=value-6, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,944 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 48 09:59:06,944 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 2 09:59:06,944 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 229 09:59:06,944 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 118 09:59:06,944 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 71 09:59:06,944 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 72 09:59:06,944 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 233 09:59:06,944 TRACE (testng-Test:[]) [Test] Listener received event EventImpl{type=CACHE_ENTRY_CREATED, pre=false, cache=Cache 'DistInitialTransferListener'@Test-NodeA-7051, key=key-5, value=value-5, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 09:59:06,944 TRACE (testng-Test:[]) [DistributedQueueingSegmentListener] Completed segment 24 09:59:06,944 TRACE (testng-Test:[]) [CacheNotifierImpl] Listener 595e9e4b-b93e-48aa-82c7-ad621f55d287 initial state for cache completed 09:59:06,944 DEBUG (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$LocalDistributedTaskPart@bf32f5f[Not completed] to self 09:59:06,945 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@2c1cbfad[Not completed] to remote execution at node Test-NodeB-10318 09:59:06,945 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7dcc17a7] to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,945 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7dcc17a7], mode=SYNCHRONOUS, timeout=15000 09:59:06,945 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7dcc17a7] to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:06,945 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92129] on Test-NodeB-10318 09:59:06,945 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #185, conn_id=1) 09:59:06,946 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92129, rsp_expected=true, UNICAST3: DATA, seqno=185, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,947 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (212 bytes (1060.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:06,947 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (215 bytes) 09:59:06,951 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92129, rsp_expected=true, UNICAST3: DATA, seqno=185, conn_id=1, TP: [cluster_name=ISPN] 09:59:06,951 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #185, conn_id=1) 09:59:06,951 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#185 09:59:06,952 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92129 09:59:06,952 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@b7e51af] [sender=Test-NodeA-7051] 09:59:06,952 TRACE (OOB-3,Test-NodeB-10318:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:06,952 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,952 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@b7e51af] 09:59:06,952 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 595e9e4b-b93e-48aa-82c7-ad621f55d287 09:59:06,952 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeB-10318, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@b7e51af] 09:59:06,952 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 92129 to Test-NodeA-7051 09:59:06,952 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #187, conn_id=0) 09:59:06,952 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92129, rsp_expected=true, UNICAST3: DATA, seqno=187, TP: [cluster_name=ISPN] 09:59:06,953 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,953 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (81 bytes) 09:59:06,953 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92129, rsp_expected=true, UNICAST3: DATA, seqno=187, TP: [cluster_name=ISPN] 09:59:06,953 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #187, conn_id=0) 09:59:06,953 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#187 09:59:06,953 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,953 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7dcc17a7] is {Test-NodeB-10318=SuccessfulResponse{responseValue=null} } 09:59:06,950 TRACE (testng-Test:[]) [DefaultExecutorService] Sending org.infinispan.distexec.DefaultExecutorService$RemoteDistributedTaskPart@6ba35b3d[Not completed] to remote execution at node Test-NodeC-52778 09:59:06,953 TRACE (testng-Test:[]) [RpcManagerImpl] Test-NodeA-7051 invoking DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7dcc17a7] to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 09:59:06,954 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7dcc17a7], mode=SYNCHRONOUS, timeout=15000 09:59:06,954 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7dcc17a7] to single recipient Test-NodeC-52778 with response mode GET_ALL 09:59:06,954 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92132] on Test-NodeC-52778 09:59:06,954 TRACE (testng-Test:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #324, conn_id=2) 09:59:06,954 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92132, rsp_expected=true, UNICAST3: DATA, seqno=324, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,956 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (213 bytes (1065.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:06,956 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (216 bytes) 09:59:06,956 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=138 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92132, rsp_expected=true, UNICAST3: DATA, seqno=324, conn_id=2, TP: [cluster_name=ISPN] 09:59:06,967 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #324, conn_id=2) 09:59:06,967 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#324 09:59:06,967 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92132 09:59:06,975 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #78) 09:59:06,975 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=78, conn_id=1, ts=109, TP: [cluster_name=ISPN] 09:59:06,975 TRACE (Timer-3,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #324) 09:59:06,975 TRACE (Timer-3,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=324, conn_id=2, ts=110, TP: [cluster_name=ISPN] 09:59:06,975 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:06,975 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:06,975 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,975 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:06,976 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=78, conn_id=1, ts=109, TP: [cluster_name=ISPN] 09:59:06,976 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeC-52778: #78, conn-id=1, ts=109) 09:59:06,976 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=324, conn_id=2, ts=110, TP: [cluster_name=ISPN] 09:59:06,976 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeC-52778: #324, conn-id=2, ts=110) 09:59:06,968 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7e9258bb] [sender=Test-NodeA-7051] 09:59:06,976 TRACE (OOB-2,Test-NodeC-52778:[]) [StateTransferLockImpl] Checking if transaction data was received for topology 0, current topology is 5 09:59:06,976 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:06,976 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [NonTotalOrderPerCacheInboundInvocationHandler] Calling perform() on DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7e9258bb] 09:59:06,977 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [ClusterListenerRemoveCallable] Removing local cluster listener due to parent cluster listener was removed : 595e9e4b-b93e-48aa-82c7-ad621f55d287 09:59:06,981 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command DistributedExecuteCommand [cache=Cache 'DistInitialTransferListener'@Test-NodeC-52778, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7e9258bb] 09:59:06,986 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #185) 09:59:06,981 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [RequestCorrelator] sending rsp for 92132 to Test-NodeA-7051 09:59:06,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #327, conn_id=0) 09:59:06,986 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=185, conn_id=1, ts=103, TP: [cluster_name=ISPN] 09:59:06,986 TRACE (remote-thread-Test-NodeC-p23887-t5:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92132, rsp_expected=true, UNICAST3: DATA, seqno=327, TP: [cluster_name=ISPN] 09:59:06,986 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #78) 09:59:06,986 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=78, conn_id=1, ts=104, TP: [cluster_name=ISPN] 09:59:06,986 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:06,986 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:06,987 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92132, rsp_expected=true, UNICAST3: DATA, seqno=327, TP: [cluster_name=ISPN] 09:59:06,987 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #327, conn_id=0) 09:59:06,987 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#327 09:59:06,987 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeC-52778value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:06,987 TRACE (OOB-2,Test-NodeA-7051:[]) [RpcManagerImpl] Response(s) to DistributedExecuteCommand [cache=null, keys=[], callable=org.infinispan.notifications.cachelistener.cluster.ClusterListenerRemoveCallable@7dcc17a7] is {Test-NodeC-52778=SuccessfulResponse{responseValue=null} } 09:59:06,987 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:59:06,987 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:06,987 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:06,988 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=185, conn_id=1, ts=103, TP: [cluster_name=ISPN] 09:59:06,988 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #185, conn-id=1, ts=103) 09:59:06,989 INFO (testng-Test:[]) [TestSuiteProgress] Test succeeded: org.infinispan.notifications.cachelistener.CacheNotifierImplInitialTransferDistTest.testSimpleCacheStartingClusterListener 09:59:06,990 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup clearContent 09:59:06,990 DEBUG (testng-Test:[]) [Test] *** Test method complete; clearing contents on all caches. 09:59:06,990 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeA-7051 09:59:06,990 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 6 09:59:06,990 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:06,990 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeB-10318 09:59:06,990 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 5 09:59:06,990 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:06,990 DEBUG (testng-Test:[]) [TestingUtil] Cleaning data for cache 'DistInitialTransferListener' on a cache manager at address Test-NodeC-52778 09:59:06,990 DEBUG (testng-Test:[]) [TestingUtil] Data container size before clear: 9 09:59:06,990 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:06,990 DEBUG (testng-Test:[]) [TestNGTestListener] After setup clearContent 09:59:06,990 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup destroy 09:59:06,990 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command SizeCommand{} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@4f810646] 09:59:06,990 TRACE (testng-Test:[]) [CallInterceptor] Invoking: SizeCommand 09:59:06,990 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command KeySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7646f167] 09:59:06,990 TRACE (testng-Test:[]) [CallInterceptor] Invoking: KeySetCommand 09:59:06,991 TRACE (testng-Test:[]) [TestingUtil] Local size on Test-NodeA-7051 before stopping: 0 09:59:06,991 DEBUG (testng-Test:[]) [CacheImpl] Stopping cache DistInitialTransferListener on Test-NodeA-7051 09:59:06,991 TRACE (testng-Test:[]) [StateTransferManagerImpl] Shutting down StateTransferManager of cache DistInitialTransferListener on node Test-NodeA-7051 09:59:06,991 DEBUG (testng-Test:[]) [LocalTopologyManagerImpl] Node Test-NodeA-7051 leaving cache DistInitialTransferListener 09:59:06,991 TRACE (testng-Test:[]) [LocalTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} 09:59:06,991 TRACE (testng-Test:[DistInitialTransferListener]) [ClusterCacheStatus] Removed node Test-NodeA-7051 from cache DistInitialTransferListener: members = [Test-NodeB-10318, Test-NodeC-52778], joiners = [] 09:59:06,988 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=78, conn_id=1, ts=104, TP: [cluster_name=ISPN] 09:59:06,999 TRACE (INT-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeB-10318: #78, conn-id=1, ts=104) 09:59:06,991 TRACE (testng-Test:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]}, members = [Test-NodeB-10318, Test-NodeC-52778], joiners = [] 09:59:07,006 TRACE (testng-Test:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1, 3: 1, 4: 1, 5: 0, 6: 0, 7: 1, 8: 1, 9: 1, 10: 1 0, 11: 0, 12: 1, 13: 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1, 19: 1, 20: 1, 21: 1, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1, 48: 1, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0 1, 60: 1, 61: 1, 62: 1, 63: 1 0, 64: 0, 65: 0, 66: 1, 67: 1, 68: 1, 69: 1, 70: 1, 71: 1, 72: 1, 73: 1, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1, 79: 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0, 88: 0, 89: 1, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1, 94: 1, 95: 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0, 101: 1, 102: 1, 103: 1, 104: 0, 105: 0, 106: 0 1, 107: 1, 108: 1, 109: 0, 110: 0, 111: 0, 112: 1, 113: 1, 114: 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1, 119: 1, 120: 1, 121: 1, 122: 1, 123: 1, 124: 1, 125: 0, 126: 0, 127: 0, 128: 1, 129: 1, 130: 1, 131: 1, 132: 1, 133: 1, 134: 1, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0, 161: 0, 162: 1, 163: 1, 164: 1 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 1, 180: 1 0, 181: 1 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0 1, 194: 0 1, 195: 1, 196: 0, 197: 0, 198: 0, 199: 1, 200: 1, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 1, 219: 1, 220: 1, 221: 1, 222: 1, 223: 1, 224: 1, 225: 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0, 238: 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1, 246: 0, 247: 0 1, 248: 0 1, 249: 1, 250: 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0, 255: 0 09:59:07,006 DEBUG (testng-Test:[DistInitialTransferListener]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache DistInitialTransferListener, topology = CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]}, availability mode = AVAILABLE 09:59:07,007 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 09:59:07,008 TRACE (transport-thread-Test-NodeA-p23728-t3:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} 09:59:07,008 TRACE (testng-Test:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} to addresses null with response mode GET_NONE 09:59:07,013 TRACE (testng-Test:[DistInitialTransferListener]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#7 09:59:07,013 TRACE (testng-Test:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 09:59:07,013 TRACE (testng-Test:[DistInitialTransferListener]) [MFC] Test-NodeA-7051 used 2647 credits, 1984149 remaining 09:59:07,013 DEBUG (testng-Test:[DistInitialTransferListener]) [ClusterCacheStatus] Queueing rebalance for cache DistInitialTransferListener with members [Test-NodeB-10318, Test-NodeC-52778] 09:59:07,011 TRACE (transport-thread-Test-NodeA-p23728-t3:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Ignoring consistent hash update 6 for cache DistInitialTransferListener that doesn't exist locally 09:59:07,013 TRACE (testng-Test:[DistInitialTransferListener]) [ClusterCacheStatus] Rebalancing consistent hash for cache DistInitialTransferListener, members are [Test-NodeB-10318, Test-NodeC-52778] 09:59:07,015 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (2698 bytes (13490.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:59:07,015 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (2701 bytes) 09:59:07,015 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (2701 bytes) 09:59:07,016 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=2647 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 09:59:07,016 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#7 09:59:07,016 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#7 09:59:07,013 TRACE (testng-Test:[DistInitialTransferListener]) [ClusterCacheStatus] Updating cache DistInitialTransferListener topology for rebalance: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,014 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #187) 09:59:07,024 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=187, ts=122, TP: [cluster_name=ISPN] 09:59:07,028 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:07,028 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:07,028 TRACE (INT-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=187, ts=122, TP: [cluster_name=ISPN] 09:59:07,016 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:59:07,029 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:59:07,030 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,030 TRACE (remote-thread-Test-NodeB-p23775-t6:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:59:07,016 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (3 headers), size=2647 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 09:59:07,030 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received Test-NodeA-7051#7 09:59:07,030 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: delivering Test-NodeA-7051#7 09:59:07,030 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:59:07,030 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:59:07,030 TRACE (remote-thread-Test-NodeC-p23887-t5:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:59:07,030 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:59:07,030 TRACE (OOB-3,Test-NodeB-10318:[]) [MFC] Test-NodeA-7051 used 2647 credits, 1984149 remaining 09:59:07,028 TRACE (INT-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #187, conn-id=0, ts=122) 09:59:07,025 TRACE (Timer-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #327) 09:59:07,033 TRACE (Timer-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=327, ts=123, TP: [cluster_name=ISPN] 09:59:07,033 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:07,033 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:07,033 TRACE (testng-Test:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]}, members = [Test-NodeB-10318, Test-NodeC-52778], joiners = [] 09:59:07,030 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:59:07,034 DEBUG (transport-thread-Test-NodeB-p23777-t4:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,030 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,034 TRACE (OOB-2,Test-NodeC-52778:[]) [MFC] Test-NodeA-7051 used 2647 credits, 1984149 remaining 09:59:07,034 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1, 3: 1, 4: 1, 5: 0, 6: 0, 7: 1, 8: 1, 9: 1, 10: 1 0, 11: 0, 12: 1, 13: 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1, 19: 1, 20: 1, 21: 1, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1, 48: 1, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0 1, 60: 1, 61: 1, 62: 1, 63: 1 0, 64: 0, 65: 0, 66: 1, 67: 1, 68: 1, 69: 1, 70: 1, 71: 1, 72: 1, 73: 1, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1, 79: 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0, 88: 0, 89: 1, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1, 94: 1, 95: 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0, 101: 1, 102: 1, 103: 1, 104: 0, 105: 0, 106: 0 1, 107: 1, 108: 1, 109: 0, 110: 0, 111: 0, 112: 1, 113: 1, 114: 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1, 119: 1, 120: 1, 121: 1, 122: 1, 123: 1, 124: 1, 125: 0, 126: 0, 127: 0, 128: 1, 129: 1, 130: 1, 131: 1, 132: 1, 133: 1, 134: 1, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0, 161: 0, 162: 1, 163: 1, 164: 1 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 1, 180: 1 0, 181: 1 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0 1, 194: 0 1, 195: 1, 196: 0, 197: 0, 198: 0, 199: 1, 200: 1, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 1, 219: 1, 220: 1, 221: 1, 222: 1, 223: 1, 224: 1, 225: 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0, 238: 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1, 246: 0, 247: 0 1, 248: 0 1, 249: 1, 250: 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0, 255: 0 09:59:07,035 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:59:07,035 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = true, topology = CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,035 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [StateTransferLockImpl] Signalling topology 6 is installed 09:59:07,035 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 5, 6, 10, 11, 14, 15, 16, 17, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 63, 64, 65, 74, 75, 76, 77, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 90, 91, 92, 96, 97, 98, 99, 100, 104, 105, 106, 109, 110, 111, 114, 115, 116, 117, 125, 126, 127, 135, 136, 137, 138, 140, 141, 142, 143, 144, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 196, 197, 198, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 239, 240, 241, 242, 243, 244, 246, 247, 248, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 5, 6, 10, 11, 14, 15, 16, 17, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 63, 64, 65, 74, 75, 76, 77, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 90, 91, 92, 96, 97, 98, 99, 100, 104, 105, 106, 109, 110, 111, 114, 115, 116, 117, 125, 126, 127, 135, 136, 137, 138, 140, 141, 142, 143, 144, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 196, 197, 198, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 239, 240, 241, 242, 243, 244, 246, 247, 248, 250, 251, 252, 253, 254, 255] 09:59:07,036 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [] 09:59:07,036 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 09:59:07,036 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [StateTransferLockImpl] Signalling transaction data received for topology 6 09:59:07,036 DEBUG (transport-thread-Test-NodeB-p23777-t4:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:59:07,036 TRACE (transport-thread-Test-NodeB-p23777-t4:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:59:07,034 TRACE (testng-Test:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1, 3: 1, 4: 1, 5: 0, 6: 0, 7: 1, 8: 1, 9: 1, 10: 1 0, 11: 0, 12: 1, 13: 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1, 19: 1, 20: 1, 21: 1, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1, 48: 1, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0 1, 60: 1, 61: 1, 62: 1, 63: 1 0, 64: 0, 65: 0, 66: 1, 67: 1, 68: 1, 69: 1, 70: 1, 71: 1, 72: 1, 73: 1, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1, 79: 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0, 88: 0, 89: 1, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1, 94: 1, 95: 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0, 101: 1, 102: 1, 103: 1, 104: 0, 105: 0, 106: 0 1, 107: 1, 108: 1, 109: 0, 110: 0, 111: 0, 112: 1, 113: 1, 114: 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1, 119: 1, 120: 1, 121: 1, 122: 1, 123: 1, 124: 1, 125: 0, 126: 0, 127: 0, 128: 1, 129: 1, 130: 1, 131: 1, 132: 1, 133: 1, 134: 1, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0, 161: 0, 162: 1, 163: 1, 164: 1 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 1, 180: 1 0, 181: 1 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0 1, 194: 0 1, 195: 1, 196: 0, 197: 0, 198: 0, 199: 1, 200: 1, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 1, 219: 1, 220: 1, 221: 1, 222: 1, 223: 1, 224: 1, 225: 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0, 238: 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1, 246: 0, 247: 0 1, 248: 0 1, 249: 1, 250: 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0, 255: 0 09:59:07,036 TRACE (testng-Test:[DistInitialTransferListener]) [CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1 0, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 0 1, 10: 1 0, 11: 0 1, 12: 0 1, 13: 1 0, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1 0, 19: 1 0, 20: 0 1, 21: 1 0, 22: 1 0, 23: 1 0, 24: 0 1, 25: 1 0, 26: 0 1, 27: 0 1, 28: 0 1, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0 1, 33: 0 1, 34: 0 1, 35: 0 1, 36: 0 1, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1 0, 48: 1 0, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 0 1, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 1 0, 68: 1 0, 69: 1 0, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1 0, 79: 1 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0 1, 88: 0 1, 89: 1 0, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1 0, 94: 1 0, 95: 0 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0 1, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 1 0, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 0 1, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1 0, 119: 1 0, 120: 1 0, 121: 0 1, 122: 1 0, 123: 1 0, 124: 1 0, 125: 0 1, 126: 0 1, 127: 0 1, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 1 0, 134: 1 0, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1 0, 140: 0 1, 141: 0 1, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 1 0, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 1 0, 164: 1 0, 165: 0 1, 166: 0 1, 167: 0 1, 168: 0 1, 169: 0 1, 170: 0 1, 171: 1 0, 172: 1 0, 173: 1 0, 174: 1 0, 175: 1 0, 176: 1 0, 177: 0 1, 178: 0 1, 179: 0 1, 180: 1 0, 181: 1 0, 182: 0 1, 183: 0 1, 184: 0 1, 185: 1 0, 186: 0 1, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 1 0, 193: 0 1, 194: 0 1, 195: 1 0, 196: 1 0, 197: 1 0, 198: 0 1, 199: 0 1, 200: 1 0, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0 1, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 0 1, 218: 1 0, 219: 1 0, 220: 1 0, 221: 0 1, 222: 1 0, 223: 1 0, 224: 1 0, 225: 0 1, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0 1, 238: 1 0, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1 0, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0 1, 255: 0 1 09:59:07,038 TRACE (testng-Test:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Initialized rebalance confirmation collector 7@DistInitialTransferListener, initial list is [Test-NodeB-10318, Test-NodeC-52778] 09:59:07,038 INFO (testng-Test:[DistInitialTransferListener]) [CLUSTER] ISPN000310: Starting cluster-wide rebalance for cache DistInitialTransferListener, topology CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,038 INFO (testng-Test:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener][Scope=Test-NodeA-7051]ISPN100002: Started local rebalance 09:59:07,038 TRACE (transport-thread-Test-NodeA-p23728-t1:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, availabilityMode=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} 09:59:07,038 TRACE (transport-thread-Test-NodeA-p23728-t1:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Ignoring rebalance 7 for cache DistInitialTransferListener that doesn't exist locally 09:59:07,038 TRACE (INT-1,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=327, ts=123, TP: [cluster_name=ISPN] 09:59:07,038 TRACE (INT-1,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- ACK(Test-NodeA-7051: #327, conn-id=0, ts=123) 09:59:07,039 TRACE (testng-Test:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, availabilityMode=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 09:59:07,041 TRACE (testng-Test:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, availabilityMode=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} to addresses null with response mode GET_NONE 09:59:07,041 TRACE (testng-Test:[DistInitialTransferListener]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#8 09:59:07,042 TRACE (testng-Test:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 09:59:07,045 TRACE (testng-Test:[DistInitialTransferListener]) [MFC] Test-NodeA-7051 used 5785 credits, 1978364 remaining 09:59:07,045 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (5836 bytes (29180.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:59:07,045 TRACE (testng-Test:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Rebalance confirmation collector 7@DistInitialTransferListener members list updated, remaining list is [Test-NodeB-10318, Test-NodeC-52778] 09:59:07,045 TRACE (testng-Test:[]) [StateConsumerImpl] Shutting down StateConsumer of cache DistInitialTransferListener on node Test-NodeA-7051 09:59:07,045 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (5839 bytes) 09:59:07,052 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (5839 bytes) 09:59:07,052 TRACE (testng-Test:[]) [StateProviderImpl] Shutting down StateProvider of cache DistInitialTransferListener on node Test-NodeA-7051 09:59:07,052 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=5785 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 09:59:07,052 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#8 09:59:07,052 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#8 09:59:07,052 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:59:07,052 DEBUG (testng-Test:[]) [TransactionTable] Wait for on-going transactions to finish for 0 milliseconds. 09:59:07,052 DEBUG (testng-Test:[]) [TransactionTable] All transactions terminated 09:59:07,052 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:07,052 DEBUG (testng-Test:[]) [BackupReceiverRepositoryImpl] Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'DistInitialTransferListener' 09:59:07,053 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command SizeCommand{} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@20496867] 09:59:07,052 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, availabilityMode=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:59:07,053 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (3 headers), size=5785 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 09:59:07,054 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received Test-NodeA-7051#8 09:59:07,054 TRACE (testng-Test:[]) [CallInterceptor] Invoking: SizeCommand 09:59:07,054 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command KeySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@56e75122] 09:59:07,054 TRACE (remote-thread-Test-NodeB-p23775-t6:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:59:07,054 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: delivering Test-NodeA-7051#8 09:59:07,056 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:59:07,056 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=REBALANCE_START, sender=Test-NodeA-7051, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, availabilityMode=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:59:07,057 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,057 TRACE (OOB-2,Test-NodeC-52778:[]) [MFC] Test-NodeA-7051 used 5785 credits, 1978364 remaining 09:59:07,054 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,054 TRACE (testng-Test:[]) [CallInterceptor] Invoking: KeySetCommand 09:59:07,057 TRACE (remote-thread-Test-NodeC-p23887-t6:[DistInitialTransferListener]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 0 09:59:07,057 TRACE (OOB-3,Test-NodeB-10318:[]) [MFC] Test-NodeA-7051 used 5785 credits, 1978364 remaining 09:59:07,061 TRACE (testng-Test:[]) [TestingUtil] Local size on Test-NodeB-10318 before stopping: 0 09:59:07,061 DEBUG (testng-Test:[]) [CacheImpl] Stopping cache DistInitialTransferListener on Test-NodeB-10318 09:59:07,063 TRACE (testng-Test:[]) [StateTransferManagerImpl] Shutting down StateTransferManager of cache DistInitialTransferListener on node Test-NodeB-10318 09:59:07,065 DEBUG (testng-Test:[]) [LocalTopologyManagerImpl] Node Test-NodeB-10318 leaving cache DistInitialTransferListener 09:59:07,065 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeB-10318, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=SYNCHRONOUS, timeout=240000 09:59:07,066 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeB-10318, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:07,066 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeB-10318: invoking unicast RPC [req-id=92139] on Test-NodeA-7051 09:59:07,066 TRACE (testng-Test:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #188, conn_id=0) 09:59:07,066 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92139, rsp_expected=true, UNICAST3: DATA, seqno=188, TP: [cluster_name=ISPN] 09:59:07,066 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:07,066 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (140 bytes) 09:59:07,069 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=63 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92139, rsp_expected=true, UNICAST3: DATA, seqno=188, TP: [cluster_name=ISPN] 09:59:07,069 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #188, conn_id=0) 09:59:07,069 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#188 09:59:07,069 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92139 09:59:07,069 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeB-10318, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} [sender=Test-NodeB-10318] 09:59:07,069 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,070 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Removed node Test-NodeB-10318 from cache DistInitialTransferListener: members = [Test-NodeC-52778], joiners = [] 09:59:07,070 WARN (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CLUSTER] [Context=DistInitialTransferListener]ISPN000312: Lost data because of graceful leaver Test-NodeB-10318 09:59:07,070 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, unionCH=null, actualMembers=[Test-NodeC-52778], persistentUUIDs=[3b86e938-cae6-4329-b29b-08820b7af692]}, members = [Test-NodeC-52778], joiners = [] 09:59:07,070 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 09:59:07,070 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CacheTopology] Pending consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 09:59:07,070 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterTopologyManagerImpl] Updating cluster-wide current topology for cache DistInitialTransferListener, topology = CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, unionCH=null, actualMembers=[Test-NodeC-52778], persistentUUIDs=[3b86e938-cae6-4329-b29b-08820b7af692]}, availability mode = AVAILABLE 09:59:07,071 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, availabilityMode=AVAILABLE, actualMembers=[Test-NodeC-52778], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 09:59:07,071 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, availabilityMode=AVAILABLE, actualMembers=[Test-NodeC-52778], throwable=null, viewId=2} to addresses null with response mode GET_NONE 09:59:07,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#9 09:59:07,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 09:59:07,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [MFC] Test-NodeA-7051 used 4296 credits, 1974068 remaining 09:59:07,077 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Queueing rebalance for cache DistInitialTransferListener with members [Test-NodeC-52778] 09:59:07,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Postponing rebalance for cache DistInitialTransferListener, there's already a rebalance in progress: RebalanceConfirmationCollector{cacheName=DistInitialTransferListenertopologyId=7, confirmationsNeeded=[Test-NodeB-10318, Test-NodeC-52778]} 09:59:07,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [RebalanceConfirmationCollector] Rebalance confirmation collector 7@DistInitialTransferListener members list updated, remaining list is [Test-NodeC-52778] 09:59:07,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeB-10318, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} 09:59:07,077 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 92139 to Test-NodeB-10318 09:59:07,078 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #186, conn_id=1) 09:59:07,078 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92139, rsp_expected=true, UNICAST3: DATA, seqno=186, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,071 TRACE (transport-thread-Test-NodeA-p23728-t6:[]) [ClusterTopologyManagerImpl] Attempting to execute command on self: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, availabilityMode=AVAILABLE, actualMembers=[Test-NodeC-52778], throwable=null, viewId=2} 09:59:07,078 TRACE (transport-thread-Test-NodeA-p23728-t6:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Ignoring consistent hash update 8 for cache DistInitialTransferListener that doesn't exist locally 09:59:07,077 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (4347 bytes (21735.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:59:07,078 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (4350 bytes) 09:59:07,078 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (4350 bytes) 09:59:07,078 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:07,078 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (81 bytes) 09:59:07,078 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=4296 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 09:59:07,078 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#9 09:59:07,078 TRACE (OOB-3,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#9 09:59:07,079 TRACE (OOB-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92139, rsp_expected=true, UNICAST3: DATA, seqno=186, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,079 TRACE (OOB-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #186, conn_id=1) 09:59:07,079 TRACE (OOB-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#186 09:59:07,079 TRACE (OOB-2,Test-NodeB-10318:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:07,079 TRACE (testng-Test:[]) [StateConsumerImpl] Shutting down StateConsumer of cache DistInitialTransferListener on node Test-NodeB-10318 09:59:07,079 TRACE (testng-Test:[]) [StateProviderImpl] Shutting down StateProvider of cache DistInitialTransferListener on node Test-NodeB-10318 09:59:07,080 DEBUG (testng-Test:[]) [TransactionTable] Wait for on-going transactions to finish for 0 milliseconds. 09:59:07,080 DEBUG (testng-Test:[]) [TransactionTable] All transactions terminated 09:59:07,080 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:07,080 DEBUG (testng-Test:[]) [BackupReceiverRepositoryImpl] Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'DistInitialTransferListener' 09:59:07,080 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command SizeCommand{} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@5adcff28] 09:59:07,080 TRACE (testng-Test:[]) [CallInterceptor] Invoking: SizeCommand 09:59:07,080 TRACE (testng-Test:[]) [InvocationContextInterceptor] Invoked with command KeySetCommand{cache=DistInitialTransferListener} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@365edb10] 09:59:07,080 TRACE (testng-Test:[]) [CallInterceptor] Invoking: KeySetCommand 09:59:07,081 TRACE (testng-Test:[]) [TestingUtil] Local size on Test-NodeC-52778 before stopping: 0 09:59:07,081 DEBUG (testng-Test:[]) [CacheImpl] Stopping cache DistInitialTransferListener on Test-NodeC-52778 09:59:07,081 TRACE (testng-Test:[]) [StateTransferManagerImpl] Shutting down StateTransferManager of cache DistInitialTransferListener on node Test-NodeC-52778 09:59:07,081 DEBUG (testng-Test:[]) [LocalTopologyManagerImpl] Node Test-NodeC-52778 leaving cache DistInitialTransferListener 09:59:07,081 TRACE (testng-Test:[]) [JGroupsTransport] dests=[Test-NodeA-7051], command=CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeC-52778, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=SYNCHRONOUS, timeout=240000 09:59:07,081 TRACE (testng-Test:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeC-52778, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient Test-NodeA-7051 with response mode GET_ALL 09:59:07,081 TRACE (testng-Test:[]) [RequestCorrelator] Test-NodeC-52778: invoking unicast RPC [req-id=92141] on Test-NodeA-7051 09:59:07,081 TRACE (testng-Test:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #328, conn_id=0) 09:59:07,078 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:59:07,081 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92141, rsp_expected=true, UNICAST3: DATA, seqno=328, TP: [cluster_name=ISPN] 09:59:07,081 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (138 bytes (690.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:07,081 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (141 bytes) 09:59:07,081 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, availabilityMode=AVAILABLE, actualMembers=[Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:59:07,079 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: , src: Test-NodeA-7051 (3 headers), size=4296 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 09:59:07,082 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: received Test-NodeA-7051#9 09:59:07,082 TRACE (OOB-2,Test-NodeC-52778:[]) [NAKACK2] Test-NodeC-52778: delivering Test-NodeA-7051#9 09:59:07,082 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 09:59:07,082 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=CH_UPDATE, sender=Test-NodeA-7051, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (1)[Test-NodeC-52778: 256+0]}, availabilityMode=AVAILABLE, actualMembers=[Test-NodeC-52778], throwable=null, viewId=2} [sender=Test-NodeA-7051] 09:59:07,083 TRACE (OOB-2,Test-NodeC-52778:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,083 TRACE (OOB-2,Test-NodeC-52778:[]) [MFC] Test-NodeA-7051 used 4296 credits, 1974068 remaining 09:59:07,083 TRACE (remote-thread-Test-NodeC-p23887-t6:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Ignoring consistent hash update 8 for cache DistInitialTransferListener that doesn't exist locally 09:59:07,082 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=63 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92141, rsp_expected=true, UNICAST3: DATA, seqno=328, TP: [cluster_name=ISPN] 09:59:07,084 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #328, conn_id=0) 09:59:07,084 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#328 09:59:07,084 TRACE (OOB-2,Test-NodeA-7051:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92141 09:59:07,084 TRACE (OOB-2,Test-NodeA-7051:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeC-52778, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} [sender=Test-NodeC-52778] 09:59:07,084 TRACE (OOB-2,Test-NodeA-7051:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,084 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Removed node Test-NodeC-52778 from cache DistInitialTransferListener: members = [], joiners = [] 09:59:07,084 DEBUG (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [PreferAvailabilityStrategy] The last node of cache DistInitialTransferListener left 09:59:07,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener no longer has any members, removing topology 09:59:07,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener topology updated: null, members = [], joiners = [] 09:59:07,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[DistInitialTransferListener]) [ClusterCacheStatus] Cache DistInitialTransferListener stable topology updated: members = [], joiners = [], topology = null 09:59:07,091 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=null} for command CacheTopologyControlCommand{cache=DistInitialTransferListener, type=LEAVE, sender=Test-NodeC-52778, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} 09:59:07,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [RequestCorrelator] sending rsp for 92141 to Test-NodeC-52778 09:59:07,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeC-52778: #325, conn_id=2) 09:59:07,092 TRACE (remote-thread-Test-NodeA-p23726-t6:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92141, rsp_expected=true, UNICAST3: DATA, seqno=325, conn_id=2, TP: [cluster_name=ISPN] 09:59:07,092 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:07,092 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:07,092 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92141, rsp_expected=true, UNICAST3: DATA, seqno=325, conn_id=2, TP: [cluster_name=ISPN] 09:59:07,092 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeA-7051: #325, conn_id=2) 09:59:07,092 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeA-7051#325 09:59:07,092 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: sender=Test-NodeA-7051value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 09:59:07,105 TRACE (testng-Test:[]) [StateConsumerImpl] Shutting down StateConsumer of cache DistInitialTransferListener on node Test-NodeC-52778 09:59:07,113 TRACE (testng-Test:[]) [StateProviderImpl] Shutting down StateProvider of cache DistInitialTransferListener on node Test-NodeC-52778 09:59:07,114 DEBUG (testng-Test:[]) [TransactionTable] Wait for on-going transactions to finish for 0 milliseconds. 09:59:07,114 DEBUG (testng-Test:[]) [TransactionTable] All transactions terminated 09:59:07,115 TRACE (testng-Test:[]) [DefaultDataContainer] Clearing data container 09:59:07,115 DEBUG (testng-Test:[]) [BackupReceiverRepositoryImpl] Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'DistInitialTransferListener' 09:59:07,116 DEBUG (testng-Test:[]) [DefaultCacheManager] Stopping cache manager ISPN on Test-NodeC-52778 09:59:07,117 TRACE (testng-Test:[]) [DefaultCacheManager] Cache stop order: [DistInitialTransferListener] 09:59:07,120 TRACE (testng-Test:[]) [DefaultCacheManager] Ignoring cache DistInitialTransferListener, it is already terminated. 09:59:07,120 TRACE (testng-Test:[]) [LocalTopologyManagerImpl] Stopping LocalTopologyManager on Test-NodeC-52778 09:59:07,120 INFO (testng-Test:[]) [JGroupsTransport] ISPN000080: Disconnecting JGroups channel ISPN 09:59:07,120 TRACE (testng-Test:[]) [GMS] Test-NodeC-52778: sending LEAVE request to Test-NodeA-7051 09:59:07,120 TRACE (testng-Test:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeA-7051: #329, conn_id=0) 09:59:07,120 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are GMS: GmsHeader[LEAVE_REQ]: mbr=Test-NodeC-52778, UNICAST3: DATA, seqno=329, TP: [cluster_name=ISPN] 09:59:07,120 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (84 bytes (420.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:07,121 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (87 bytes) 09:59:07,121 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeC-52778 (3 headers), size=0 bytes, flags=OOB], headers are GMS: GmsHeader[LEAVE_REQ]: mbr=Test-NodeC-52778, UNICAST3: DATA, seqno=329, TP: [cluster_name=ISPN] 09:59:07,121 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeC-52778: #329, conn_id=0) 09:59:07,121 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeC-52778#329 09:59:07,125 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,125 TRACE (OOB-3,Test-NodeB-10318:[]) [MFC] Test-NodeA-7051 used 4296 credits, 1974068 remaining 09:59:07,127 TRACE (remote-thread-Test-NodeB-p23775-t5:[DistInitialTransferListener]) [LocalTopologyManagerImpl] Ignoring consistent hash update 8 for cache DistInitialTransferListener that doesn't exist locally 09:59:07,156 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:59:07,156 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:59:07,157 DEBUG (transport-thread-Test-NodeB-p23777-t5:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,163 DEBUG (transport-thread-Test-NodeB-p23777-t5:[]) [LocalTopologyManagerImpl] Starting local rebalance for cache DistInitialTransferListener, topology = CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,163 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1, 3: 1, 4: 1, 5: 0, 6: 0, 7: 1, 8: 1, 9: 1, 10: 1 0, 11: 0, 12: 1, 13: 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1, 19: 1, 20: 1, 21: 1, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1, 48: 1, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0 1, 60: 1, 61: 1, 62: 1, 63: 1 0, 64: 0, 65: 0, 66: 1, 67: 1, 68: 1, 69: 1, 70: 1, 71: 1, 72: 1, 73: 1, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1, 79: 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0, 88: 0, 89: 1, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1, 94: 1, 95: 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0, 101: 1, 102: 1, 103: 1, 104: 0, 105: 0, 106: 0 1, 107: 1, 108: 1, 109: 0, 110: 0, 111: 0, 112: 1, 113: 1, 114: 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1, 119: 1, 120: 1, 121: 1, 122: 1, 123: 1, 124: 1, 125: 0, 126: 0, 127: 0, 128: 1, 129: 1, 130: 1, 131: 1, 132: 1, 133: 1, 134: 1, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0, 161: 0, 162: 1, 163: 1, 164: 1 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 1, 180: 1 0, 181: 1 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0 1, 194: 0 1, 195: 1, 196: 0, 197: 0, 198: 0, 199: 1, 200: 1, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 1, 219: 1, 220: 1, 221: 1, 222: 1, 223: 1, 224: 1, 225: 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0, 238: 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1, 246: 0, 247: 0 1, 248: 0 1, 249: 1, 250: 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0, 255: 0 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1 0, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 0 1, 10: 1 0, 11: 0 1, 12: 0 1, 13: 1 0, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1 0, 19: 1 0, 20: 0 1, 21: 1 0, 22: 1 0, 23: 1 0, 24: 0 1, 25: 1 0, 26: 0 1, 27: 0 1, 28: 0 1, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0 1, 33: 0 1, 34: 0 1, 35: 0 1, 36: 0 1, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1 0, 48: 1 0, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 0 1, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 1 0, 68: 1 0, 69: 1 0, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1 0, 79: 1 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0 1, 88: 0 1, 89: 1 0, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1 0, 94: 1 0, 95: 0 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0 1, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 1 0, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 0 1, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1 0, 119: 1 0, 120: 1 0, 121: 0 1, 122: 1 0, 123: 1 0, 124: 1 0, 125: 0 1, 126: 0 1, 127: 0 1, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 1 0, 134: 1 0, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1 0, 140: 0 1, 141: 0 1, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 1 0, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 1 0, 164: 1 0, 165: 0 1, 166: 0 1, 167: 0 1, 168: 0 1, 169: 0 1, 170: 0 1, 171: 1 0, 172: 1 0, 173: 1 0, 174: 1 0, 175: 1 0, 176: 1 0, 177: 0 1, 178: 0 1, 179: 0 1, 180: 1 0, 181: 1 0, 182: 0 1, 183: 0 1, 184: 0 1, 185: 1 0, 186: 0 1, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 1 0, 193: 0 1, 194: 0 1, 195: 1 0, 196: 1 0, 197: 1 0, 198: 0 1, 199: 0 1, 200: 1 0, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0 1, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 0 1, 218: 1 0, 219: 1 0, 220: 1 0, 221: 0 1, 222: 1 0, 223: 1 0, 224: 1 0, 225: 0 1, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0 1, 238: 1 0, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1 0, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0 1, 255: 0 1 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+114, Test-NodeC-52778: 114+142]}, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = true, isMember = true, topology = CacheTopology{id=7, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+114, Test-NodeC-52778: 114+142]}, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] Start keeping track of keys for rebalance 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateTransferLockImpl] Signalling topology 7 is installed 09:59:07,164 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 5, 6, 10, 11, 14, 15, 16, 17, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 63, 64, 65, 74, 75, 76, 77, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 90, 91, 92, 96, 97, 98, 99, 100, 104, 105, 106, 109, 110, 111, 114, 115, 116, 117, 125, 126, 127, 135, 136, 137, 138, 140, 141, 142, 143, 144, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 196, 197, 198, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 239, 240, 241, 242, 243, 244, 246, 247, 248, 250, 251, 252, 253, 254, 255] 09:59:07,165 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: [2, 3, 4, 7, 8, 9, 12, 13, 18, 19, 20, 21, 47, 48, 60, 61, 62, 66, 67, 68, 69, 70, 71, 72, 73, 78, 89, 93, 94, 95, 101, 102, 103, 107, 108, 112, 113, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 139, 145, 146, 162, 163, 179, 195, 199, 200, 218, 219, 220, 221, 222, 223, 224, 238, 245, 249]; removed segments: [] 09:59:07,165 DEBUG (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] Adding inbound state transfer for segments [2, 3, 4, 7, 8, 9, 12, 13, 18, 19, 20, 21, 47, 48, 60, 61, 62, 66, 67, 68, 69, 70, 71, 72, 73, 78, 89, 93, 94, 95, 101, 102, 103, 107, 108, 112, 113, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 139, 145, 146, 162, 163, 179, 195, 199, 200, 218, 219, 220, 221, 222, 223, 224, 238, 245, 249] of cache DistInitialTransferListener 09:59:07,165 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] Adding transfer from Test-NodeC-52778 for segments [128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124] 09:59:07,165 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:59:07,165 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] Finished adding inbound state transfer for segments [2, 3, 4, 7, 8, 9, 12, 13, 18, 19, 20, 21, 47, 48, 60, 61, 62, 66, 67, 68, 69, 70, 71, 72, 73, 78, 89, 93, 94, 95, 101, 102, 103, 107, 108, 112, 113, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 139, 145, 146, 162, 163, 179, 195, 199, 200, 218, 219, 220, 221, 222, 223, 224, 238, 245, 249] of cache DistInitialTransferListener 09:59:07,165 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 7, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]} 09:59:07,165 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [StateTransferLockImpl] Signalling transaction data received for topology 7 09:59:07,165 DEBUG (transport-thread-Test-NodeB-p23777-t5:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:59:07,165 TRACE (transport-thread-Test-NodeB-p23777-t5:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:59:07,165 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:59:07,165 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [InboundTransferTask] Requesting segments [128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124] of cache DistInitialTransferListener from node Test-NodeC-52778 09:59:07,165 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [RpcManagerImpl] Test-NodeB-10318 invoking StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=7, segments=[128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124]} to recipient list [Test-NodeC-52778] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 09:59:07,165 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [JGroupsTransport] dests=[Test-NodeC-52778], command=StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=7, segments=[128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 09:59:07,165 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=7, segments=[128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124]} to addresses [Test-NodeC-52778] with response mode GET_ALL 09:59:07,165 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [RequestCorrelator] Test-NodeB-10318: invoking multicast RPC [req-id=92147] 09:59:07,165 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #79, conn_id=1) 09:59:07,165 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92147, rsp_expected=true, UNICAST3: DATA, seqno=79, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,166 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (486 bytes (2430.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:07,166 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (489 bytes) 09:59:07,167 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [SemaphoreCompletionService] Task started, tasks in queue 1, available permits 0 09:59:07,167 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:59:07,167 DEBUG (transport-thread-Test-NodeC-p23889-t4:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,167 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1, 3: 1, 4: 1, 5: 0, 6: 0, 7: 1, 8: 1, 9: 1, 10: 1 0, 11: 0, 12: 1, 13: 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1, 19: 1, 20: 1, 21: 1, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1, 48: 1, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0 1, 60: 1, 61: 1, 62: 1, 63: 1 0, 64: 0, 65: 0, 66: 1, 67: 1, 68: 1, 69: 1, 70: 1, 71: 1, 72: 1, 73: 1, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1, 79: 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0, 88: 0, 89: 1, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1, 94: 1, 95: 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0, 101: 1, 102: 1, 103: 1, 104: 0, 105: 0, 106: 0 1, 107: 1, 108: 1, 109: 0, 110: 0, 111: 0, 112: 1, 113: 1, 114: 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1, 119: 1, 120: 1, 121: 1, 122: 1, 123: 1, 124: 1, 125: 0, 126: 0, 127: 0, 128: 1, 129: 1, 130: 1, 131: 1, 132: 1, 133: 1, 134: 1, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0, 161: 0, 162: 1, 163: 1, 164: 1 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 1, 180: 1 0, 181: 1 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0 1, 194: 0 1, 195: 1, 196: 0, 197: 0, 198: 0, 199: 1, 200: 1, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 1, 219: 1, 220: 1, 221: 1, 222: 1, 223: 1, 224: 1, 225: 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0, 238: 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1, 246: 0, 247: 0 1, 248: 0 1, 249: 1, 250: 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0, 255: 0 09:59:07,167 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:59:07,167 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = false, isMember = true, topology = CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=null, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,167 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateTransferLockImpl] Signalling topology 6 is installed 09:59:07,167 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=412 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92147, rsp_expected=true, UNICAST3: DATA, seqno=79, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,167 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #79, conn_id=1) 09:59:07,167 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#79 09:59:07,167 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92147 09:59:07,167 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=7, segments=[128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124]} [sender=Test-NodeB-10318] 09:59:07,168 TRACE (OOB-2,Test-NodeC-52778:[]) [GlobalInboundInvocationHandler] Silently ignoring that DistInitialTransferListener cache is not defined 09:59:07,168 TRACE (OOB-2,Test-NodeC-52778:[]) [CommandAwareRpcDispatcher] About to send back response CacheNotFoundResponse for command StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=7, segments=[128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124]} 09:59:07,168 TRACE (OOB-2,Test-NodeC-52778:[]) [RequestCorrelator] sending rsp for 92147 to Test-NodeB-10318 09:59:07,168 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #79, conn_id=1) 09:59:07,168 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92147, rsp_expected=true, UNICAST3: DATA, seqno=79, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,168 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:07,168 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (80 bytes) 09:59:07,170 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=3 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92147, rsp_expected=true, UNICAST3: DATA, seqno=79, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,170 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #79, conn_id=1) 09:59:07,170 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#79 09:59:07,170 TRACE (OOB-3,Test-NodeB-10318:[]) [JGroupsTransport] Responses: Responses{ Test-NodeC-52778: sender=Test-NodeC-52778value=CacheNotFoundResponse, received=true, suspected=false} 09:59:07,170 TRACE (OOB-3,Test-NodeB-10318:[]) [RpcManagerImpl] Response(s) to StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeB-10318, type=START_STATE_TRANSFER, topologyId=7, segments=[128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124]} is {Test-NodeC-52778=CacheNotFoundResponse} 09:59:07,170 WARN (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [InboundTransferTask] ISPN000210: Failed to request segments [128, 129, 2, 130, 3, 131, 4, 132, 133, 134, 7, 8, 9, 139, 12, 13, 145, 18, 146, 19, 20, 21, 162, 163, 47, 48, 179, 60, 61, 62, 66, 67, 195, 68, 69, 70, 71, 199, 72, 200, 73, 78, 89, 218, 219, 220, 93, 221, 94, 222, 95, 223, 224, 101, 102, 103, 107, 108, 238, 112, 113, 245, 118, 119, 120, 121, 249, 122, 123, 124] of cache DistInitialTransferListener from node Test-NodeC-52778 (node will not be retried) org.infinispan.commons.CacheException: CacheNotFoundResponse at org.infinispan.statetransfer.InboundTransferTask.requestSegments(InboundTransferTask.java:152) [classes/:?] at org.infinispan.statetransfer.StateConsumerImpl$4.call(StateConsumerImpl.java:1052) [classes/:?] at org.infinispan.statetransfer.StateConsumerImpl$4.call(StateConsumerImpl.java:1049) [classes/:?] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_101] at org.infinispan.executors.SemaphoreCompletionService$QueueingTask.runInternal(SemaphoreCompletionService.java:172) [classes/:?] at org.infinispan.executors.SemaphoreCompletionService$QueueingTask.run(SemaphoreCompletionService.java:151) [classes/:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_101] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_101] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101] 09:59:07,171 TRACE (stateTransferExecutor-thread-Test-NodeB-p23845-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:59:07,167 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253]; old segments: [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253] 09:59:07,172 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: []; removed segments: [] 09:59:07,172 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 09:59:07,172 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateTransferLockImpl] Signalling transaction data received for topology 6 09:59:07,172 DEBUG (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:59:07,172 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [SemaphoreCompletionService] Task finished, tasks in queue 1, available permits 0 09:59:07,173 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:59:07,173 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [JGroupsTransport] Waiting on view 2 being accepted 09:59:07,173 DEBUG (transport-thread-Test-NodeC-p23889-t4:[]) [LocalTopologyManagerImpl] Updating local topology for cache DistInitialTransferListener: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,184 DEBUG (transport-thread-Test-NodeC-p23889-t4:[]) [LocalTopologyManagerImpl] Starting local rebalance for cache DistInitialTransferListener, topology = CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=null, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,184 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1, 3: 1, 4: 1, 5: 0, 6: 0, 7: 1, 8: 1, 9: 1, 10: 1 0, 11: 0, 12: 1, 13: 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1, 19: 1, 20: 1, 21: 1, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1, 48: 1, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0 1, 60: 1, 61: 1, 62: 1, 63: 1 0, 64: 0, 65: 0, 66: 1, 67: 1, 68: 1, 69: 1, 70: 1, 71: 1, 72: 1, 73: 1, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1, 79: 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0, 88: 0, 89: 1, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1, 94: 1, 95: 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0, 101: 1, 102: 1, 103: 1, 104: 0, 105: 0, 106: 0 1, 107: 1, 108: 1, 109: 0, 110: 0, 111: 0, 112: 1, 113: 1, 114: 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1, 119: 1, 120: 1, 121: 1, 122: 1, 123: 1, 124: 1, 125: 0, 126: 0, 127: 0, 128: 1, 129: 1, 130: 1, 131: 1, 132: 1, 133: 1, 134: 1, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0, 161: 0, 162: 1, 163: 1, 164: 1 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 1, 180: 1 0, 181: 1 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0 1, 194: 0 1, 195: 1, 196: 0, 197: 0, 198: 0, 199: 1, 200: 1, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 1, 219: 1, 220: 1, 221: 1, 222: 1, 223: 1, 224: 1, 225: 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0, 238: 1, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1, 246: 0, 247: 0 1, 248: 0 1, 249: 1, 250: 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0, 255: 0 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 1 0, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 0 1, 10: 1 0, 11: 0 1, 12: 0 1, 13: 1 0, 14: 1 0, 15: 1 0, 16: 1 0, 17: 0 1, 18: 1 0, 19: 1 0, 20: 0 1, 21: 1 0, 22: 1 0, 23: 1 0, 24: 0 1, 25: 1 0, 26: 0 1, 27: 0 1, 28: 0 1, 29: 0 1, 30: 1 0, 31: 1 0, 32: 0 1, 33: 0 1, 34: 0 1, 35: 0 1, 36: 0 1, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 1 0, 46: 0 1, 47: 1 0, 48: 1 0, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 0 1, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 1 0, 68: 1 0, 69: 1 0, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 1 0, 75: 0 1, 76: 1 0, 77: 0 1, 78: 1 0, 79: 1 0, 80: 0 1, 81: 1 0, 82: 1 0, 83: 1 0, 84: 0 1, 85: 1 0, 86: 1 0, 87: 0 1, 88: 0 1, 89: 1 0, 90: 1 0, 91: 0 1, 92: 0 1, 93: 1 0, 94: 1 0, 95: 0 1, 96: 1 0, 97: 0 1, 98: 1 0, 99: 1 0, 100: 0 1, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 1 0, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 0 1, 115: 0 1, 116: 0 1, 117: 0 1, 118: 1 0, 119: 1 0, 120: 1 0, 121: 0 1, 122: 1 0, 123: 1 0, 124: 1 0, 125: 0 1, 126: 0 1, 127: 0 1, 128: 0 1, 129: 1 0, 130: 1 0, 131: 1 0, 132: 1 0, 133: 1 0, 134: 1 0, 135: 1 0, 136: 0 1, 137: 0 1, 138: 0 1, 139: 1 0, 140: 0 1, 141: 0 1, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 1 0, 147: 1 0, 148: 1 0, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 1 0, 154: 0 1, 155: 0 1, 156: 0 1, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 1 0, 164: 1 0, 165: 0 1, 166: 0 1, 167: 0 1, 168: 0 1, 169: 0 1, 170: 0 1, 171: 1 0, 172: 1 0, 173: 1 0, 174: 1 0, 175: 1 0, 176: 1 0, 177: 0 1, 178: 0 1, 179: 0 1, 180: 1 0, 181: 1 0, 182: 0 1, 183: 0 1, 184: 0 1, 185: 1 0, 186: 0 1, 187: 0 1, 188: 0 1, 189: 0 1, 190: 0 1, 191: 0 1, 192: 1 0, 193: 0 1, 194: 0 1, 195: 1 0, 196: 1 0, 197: 1 0, 198: 0 1, 199: 0 1, 200: 1 0, 201: 1 0, 202: 0 1, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 1 0, 211: 0 1, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 0 1, 218: 1 0, 219: 1 0, 220: 1 0, 221: 0 1, 222: 1 0, 223: 1 0, 224: 1 0, 225: 0 1, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 0 1, 231: 0 1, 232: 0 1, 233: 1 0, 234: 0 1, 235: 0 1, 236: 1 0, 237: 0 1, 238: 1 0, 239: 1 0, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 0 1, 245: 1 0, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 0 1, 252: 0 1, 253: 1 0, 254: 0 1, 255: 0 1 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateTransferManagerImpl] Installing new cache topology CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+114, Test-NodeC-52778: 114+142]}, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} on cache DistInitialTransferListener 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Received new topology for cache DistInitialTransferListener, isRebalance = true, isMember = true, topology = CacheTopology{id=7, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+44, Test-NodeC-52778: 114+51]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 142+114, Test-NodeC-52778: 114+142]}, actualMembers=[Test-NodeB-10318, Test-NodeC-52778], persistentUUIDs=[d46dbf65-fa9f-4bbf-888e-e28306c26dc0, 3b86e938-cae6-4329-b29b-08820b7af692]} 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Start keeping track of keys for rebalance 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [CommitManager] Tracking is disabled. Clear tracker: {} 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateTransferLockImpl] Signalling topology 7 is installed 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 7, 8, 9, 10, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 29, 30, 31, 38, 39, 40, 41, 44, 45, 46, 47, 48, 59, 60, 61, 62, 63, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 80, 81, 82, 83, 84, 85, 86, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103, 106, 107, 108, 112, 113, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 162, 163, 164, 179, 180, 181, 193, 194, 195, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 218, 219, 220, 221, 222, 223, 224, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 238, 239, 240, 241, 242, 243, 244, 245, 247, 248, 249, 251, 252, 253] 09:59:07,185 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] On cache DistInitialTransferListener we have: added segments: [5, 6, 11, 22, 23, 24, 25, 26, 27, 28, 32, 33, 34, 35, 36, 37, 42, 43, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 64, 65, 79, 87, 88, 100, 104, 105, 109, 110, 111, 114, 125, 126, 127, 140, 141, 142, 143, 144, 160, 161, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 196, 197, 198, 211, 212, 213, 214, 215, 216, 217, 225, 237, 246, 250, 254, 255]; removed segments: [] 09:59:07,186 DEBUG (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Adding inbound state transfer for segments [5, 6, 11, 22, 23, 24, 25, 26, 27, 28, 32, 33, 34, 35, 36, 37, 42, 43, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 64, 65, 79, 87, 88, 100, 104, 105, 109, 110, 111, 114, 125, 126, 127, 140, 141, 142, 143, 144, 160, 161, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 196, 197, 198, 211, 212, 213, 214, 215, 216, 217, 225, 237, 246, 250, 254, 255] of cache DistInitialTransferListener 09:59:07,186 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Adding transfer from Test-NodeB-10318 for segments [5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255] 09:59:07,186 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:59:07,186 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Finished adding inbound state transfer for segments [5, 6, 11, 22, 23, 24, 25, 26, 27, 28, 32, 33, 34, 35, 36, 37, 42, 43, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 64, 65, 79, 87, 88, 100, 104, 105, 109, 110, 111, 114, 125, 126, 127, 140, 141, 142, 143, 144, 160, 161, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 196, 197, 198, 211, 212, 213, 214, 215, 216, 217, 225, 237, 246, 250, 254, 255] of cache DistInitialTransferListener 09:59:07,186 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 7, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[Test-NodeB-10318: 134+122, Test-NodeC-52778: 122+134]} 09:59:07,186 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [StateTransferLockImpl] Signalling transaction data received for topology 7 09:59:07,186 DEBUG (transport-thread-Test-NodeC-p23889-t4:[]) [StateConsumerImpl] Removing no longer owned entries for cache DistInitialTransferListener 09:59:07,186 TRACE (transport-thread-Test-NodeC-p23889-t4:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:59:07,187 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:59:07,187 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [InboundTransferTask] Requesting segments [5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255] of cache DistInitialTransferListener from node Test-NodeB-10318 09:59:07,187 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [RpcManagerImpl] Test-NodeC-52778 invoking StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=7, segments=[5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255]} to recipient list [Test-NodeB-10318] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 09:59:07,187 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [JGroupsTransport] dests=[Test-NodeB-10318], command=StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=7, segments=[5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 09:59:07,188 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=7, segments=[5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255]} to addresses [Test-NodeB-10318] with response mode GET_ALL 09:59:07,188 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [RequestCorrelator] Test-NodeC-52778: invoking multicast RPC [req-id=92149] 09:59:07,188 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [UNICAST3] Test-NodeC-52778 --> DATA(Test-NodeB-10318: #80, conn_id=1) 09:59:07,189 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92149, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,190 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 1 msgs (591 bytes (2955.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:07,190 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (594 bytes) 09:59:07,190 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeC-52778 (3 headers), size=517 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92149, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeC-52778: #80, conn_id=1) 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeC-52778#80 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92149 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute CacheRpcCommand: StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=7, segments=[5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255]} [sender=Test-NodeC-52778] 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Silently ignoring that DistInitialTransferListener cache is not defined 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [CommandAwareRpcDispatcher] About to send back response CacheNotFoundResponse for command StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=7, segments=[5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255]} 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] sending rsp for 92149 to Test-NodeC-52778 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeC-52778: #80, conn_id=1) 09:59:07,191 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92149, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,191 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:07,191 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (80 bytes) 09:59:07,191 TRACE (OOB-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeB-10318 (3 headers), size=3 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92149, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,191 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778 <-- DATA(Test-NodeB-10318: #80, conn_id=1) 09:59:07,191 TRACE (OOB-2,Test-NodeC-52778:[]) [UNICAST3] Test-NodeC-52778: delivering Test-NodeB-10318#80 09:59:07,191 TRACE (OOB-2,Test-NodeC-52778:[]) [JGroupsTransport] Responses: Responses{ Test-NodeB-10318: sender=Test-NodeB-10318value=CacheNotFoundResponse, received=true, suspected=false} 09:59:07,191 TRACE (OOB-2,Test-NodeC-52778:[]) [RpcManagerImpl] Response(s) to StateRequestCommand{cache=DistInitialTransferListener, origin=Test-NodeC-52778, type=START_STATE_TRANSFER, topologyId=7, segments=[5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255]} is {Test-NodeB-10318=CacheNotFoundResponse} 09:59:07,191 WARN (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [InboundTransferTask] ISPN000210: Failed to request segments [5, 6, 11, 140, 141, 142, 143, 144, 22, 23, 24, 25, 26, 27, 28, 32, 160, 33, 161, 34, 35, 36, 37, 165, 166, 167, 168, 169, 42, 170, 43, 171, 172, 173, 174, 175, 176, 49, 177, 50, 178, 51, 52, 53, 54, 182, 55, 183, 56, 184, 57, 185, 58, 186, 187, 188, 189, 190, 191, 64, 192, 65, 196, 197, 198, 79, 211, 212, 213, 214, 87, 215, 88, 216, 217, 225, 100, 104, 105, 109, 237, 110, 111, 114, 246, 250, 125, 126, 254, 127, 255] of cache DistInitialTransferListener from node Test-NodeB-10318 (node will not be retried) org.infinispan.commons.CacheException: CacheNotFoundResponse at org.infinispan.statetransfer.InboundTransferTask.requestSegments(InboundTransferTask.java:152) [classes/:?] at org.infinispan.statetransfer.StateConsumerImpl$4.call(StateConsumerImpl.java:1052) [classes/:?] at org.infinispan.statetransfer.StateConsumerImpl$4.call(StateConsumerImpl.java:1049) [classes/:?] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_101] at org.infinispan.executors.SemaphoreCompletionService$QueueingTask.runInternal(SemaphoreCompletionService.java:172) [classes/:?] at org.infinispan.executors.SemaphoreCompletionService$QueueingTask.run(SemaphoreCompletionService.java:151) [classes/:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_101] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_101] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101] 09:59:07,191 TRACE (stateTransferExecutor-thread-Test-NodeC-p23900-t3:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:59:07,214 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: joiners=[], suspected=[], leaving=[Test-NodeC-52778], new view: [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,214 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: sending LEAVE response to Test-NodeC-52778 09:59:07,214 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster_name=ISPN] 09:59:07,214 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (57 bytes (285.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:07,214 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (60 bytes) 09:59:07,214 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: mcasting view [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] (2 mbrs) 09:59:07,215 TRACE (ViewHandler,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#10 09:59:07,215 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 09:59:07,215 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes] 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: received Test-NodeA-7051#10 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: delivering Test-NodeA-7051#10-10 (1 messages) 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: received delta view [Test-NodeA-7051|3], ref-view=[Test-NodeA-7051|2], left=[Test-NodeC-52778] 09:59:07,215 DEBUG (Incoming-1,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: installing view [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: closing connections of non members [Test-NodeC-52778] 09:59:07,215 DEBUG (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: removed Test-NodeC-52778 from xmit_table (not member anymore) 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1] 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [TOA] Handle view [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [MFC] new membership: [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [FRAG2] Test-NodeA-7051: removed Test-NodeC-52778 from fragmentation table 09:59:07,215 DEBUG (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,215 DEBUG (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] Joined: [], Left: [Test-NodeC-52778] 09:59:07,215 INFO (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:59:07,215 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:59:07,215 INFO (Incoming-1,Test-NodeA-7051:[]) [CLUSTER] ISPN100001: Node Test-NodeC-52778 left the cluster 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318], oldMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], localAddress=Test-NodeA-7051, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844429225099264 09:59:07,215 TRACE (Incoming-1,Test-NodeA-7051:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318], oldMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], localAddress=Test-NodeA-7051, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844429225099264 09:59:07,216 TRACE (Incoming-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeA-7051: #3, conn_id=0) 09:59:07,216 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 09:59:07,216 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 09:59:07,216 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (112 bytes (560.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:59:07,216 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (115 bytes) 09:59:07,216 TRACE (Incoming-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 09:59:07,216 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 09:59:07,216 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeA-7051: #3, conn_id=0) 09:59:07,216 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeA-7051#3 09:59:07,217 TRACE (INT-2,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: received [dst: Test-NodeC-52778, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster_name=ISPN] 09:59:07,218 TRACE (testng-Test:[]) [GMS] Test-NodeC-52778: got LEAVE response from Test-NodeA-7051 09:59:07,216 TRACE (Incoming-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: received Test-NodeA-7051#10 09:59:07,215 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [ClusterTopologyManagerImpl] Received new cluster view: 3, isCoordinator = true, old status = COORDINATOR 09:59:07,219 TRACE (Incoming-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: delivering Test-NodeA-7051#10-10 (1 messages) 09:59:07,219 TRACE (Incoming-1,Test-NodeB-10318:[]) [GMS] Test-NodeB-10318: received delta view [Test-NodeA-7051|3], ref-view=[Test-NodeA-7051|2], left=[Test-NodeC-52778] 09:59:07,219 DEBUG (Incoming-1,Test-NodeB-10318:[]) [GMS] Test-NodeB-10318: installing view [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,219 TRACE (Incoming-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: closing connections of non members [Test-NodeC-52778] 09:59:07,219 DEBUG (Incoming-1,Test-NodeB-10318:[]) [NAKACK2] Test-NodeB-10318: removed Test-NodeC-52778 from xmit_table (not member anymore) 09:59:07,219 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [ClusterTopologyManagerImpl] Updating cluster members for all the caches. New list is [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,219 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 09:59:07,219 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient Test-NodeB-10318 with response mode GET_ALL 09:59:07,215 TRACE (NioConnection.Reader [127.0.0.1:7900],Test-NodeC-52778:[]) [TCP_NIO2] 127.0.0.1:7902: removed connection to 127.0.0.1:7900 09:59:07,220 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [RequestCorrelator] Test-NodeA-7051: invoking unicast RPC [req-id=92153] on Test-NodeB-10318 09:59:07,225 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeB-10318: #187, conn_id=1) 09:59:07,219 TRACE (Incoming-1,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: reset digest to Test-NodeA-7051: [-1], Test-NodeB-10318: [-1] 09:59:07,225 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92153, rsp_expected=true, UNICAST3: DATA, seqno=187, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,225 TRACE (Incoming-1,Test-NodeB-10318:[]) [TOA] Handle view [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,225 TRACE (Incoming-1,Test-NodeB-10318:[]) [MFC] new membership: [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,225 TRACE (Incoming-1,Test-NodeB-10318:[]) [FRAG2] Test-NodeB-10318: removed Test-NodeC-52778 from fragmentation table 09:59:07,225 DEBUG (Incoming-1,Test-NodeB-10318:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,225 DEBUG (Incoming-1,Test-NodeB-10318:[]) [JGroupsTransport] Joined: [], Left: [Test-NodeC-52778] 09:59:07,225 INFO (Incoming-1,Test-NodeB-10318:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|3] (2) [Test-NodeA-7051, Test-NodeB-10318] 09:59:07,227 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (82 bytes (410.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:07,229 TRACE (testng-Test:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeB-10318: #80) 09:59:07,239 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeB-10318, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=80, conn_id=1, ts=111, TP: [cluster_name=ISPN] 09:59:07,239 TRACE (testng-Test:[]) [UNICAST3] Test-NodeC-52778 --> ACK(Test-NodeA-7051: #325) 09:59:07,239 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeC-52778: sending msg to Test-NodeA-7051, src=Test-NodeC-52778, headers are UNICAST3: ACK, seqno=325, conn_id=2, ts=112, TP: [cluster_name=ISPN] 09:59:07,239 DEBUG (testng-Test:[]) [TEST_PING] Stop discovery for Test-NodeC-52778 09:59:07,239 DEBUG (testng-Test:[]) [TCP_NIO2] closing sockets and stopping threads 09:59:07,227 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (85 bytes) 09:59:07,239 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] Test-NodeC-52778: sending 2 msgs (121 bytes (605.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeB-10318, ISPN:Test-NodeA-7051] 09:59:07,239 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:07,239 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] 127.0.0.1:7902: server is not running, discarding message to 127.0.0.1:7901 09:59:07,239 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] dest=127.0.0.1:7900 (64 bytes) 09:59:07,239 TRACE (TransferQueueBundler,Test-NodeC-52778:[]) [TCP_NIO2] 127.0.0.1:7902: server is not running, discarding message to 127.0.0.1:7900 09:59:07,239 TRACE (OOB-3,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=92153, rsp_expected=true, UNICAST3: DATA, seqno=187, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,239 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- DATA(Test-NodeA-7051: #187, conn_id=1) 09:59:07,239 TRACE (OOB-3,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318: delivering Test-NodeA-7051#187 09:59:07,239 TRACE (OOB-3,Test-NodeB-10318:[]) [RequestCorrelator] calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 92153 09:59:07,239 TRACE (OOB-3,Test-NodeB-10318:[]) [GlobalInboundInvocationHandler] Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=Test-NodeA-7051] 09:59:07,239 TRACE (OOB-3,Test-NodeB-10318:[]) [BlockingTaskAwareExecutorServiceImpl] Added a new task directly: 0 task(s) are waiting 09:59:07,239 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [CommandAwareRpcDispatcher] About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 09:59:07,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [RequestCorrelator] sending rsp for 92153 to Test-NodeA-7051 09:59:07,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #189, conn_id=0) 09:59:07,240 TRACE (remote-thread-Test-NodeB-p23775-t6:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92153, rsp_expected=true, UNICAST3: DATA, seqno=189, TP: [cluster_name=ISPN] 09:59:07,240 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:07,240 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (82 bytes) 09:59:07,225 TRACE (Incoming-1,Test-NodeB-10318:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:59:07,242 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92153, rsp_expected=true, UNICAST3: DATA, seqno=189, TP: [cluster_name=ISPN] 09:59:07,242 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #189, conn_id=0) 09:59:07,242 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#189 09:59:07,242 TRACE (OOB-2,Test-NodeA-7051:[]) [JGroupsTransport] Responses: sender=Test-NodeB-10318value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 09:59:07,248 TRACE (transport-thread-Test-NodeA-p23728-t5:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:59:07,280 INFO (Incoming-1,Test-NodeB-10318:[]) [CLUSTER] ISPN100001: Node Test-NodeC-52778 left the cluster 09:59:07,280 TRACE (Incoming-1,Test-NodeB-10318:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318], oldMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], localAddress=Test-NodeB-10318, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844433520066560 09:59:07,289 TRACE (Incoming-1,Test-NodeB-10318:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051, Test-NodeB-10318], oldMembers=[Test-NodeA-7051, Test-NodeB-10318, Test-NodeC-52778], localAddress=Test-NodeB-10318, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844433520066560 09:59:07,290 TRACE (Incoming-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #190, conn_id=0) 09:59:07,290 TRACE (Incoming-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=190, TP: [cluster_name=ISPN] 09:59:07,280 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:59:07,290 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [ClusterTopologyManagerImpl] Received new cluster view: 3, isCoordinator = false, old status = REGULAR_MEMBER 09:59:07,290 TRACE (transport-thread-Test-NodeB-p23777-t6:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:59:07,290 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:07,290 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (70 bytes) 09:59:07,294 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=190, TP: [cluster_name=ISPN] 09:59:07,295 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #190, conn_id=0) 09:59:07,295 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#190 09:59:07,302 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: got all ACKs (2) from members for view [Test-NodeA-7051|3] 09:59:07,357 INFO (testng-Test:[]) [JGroupsTransport] ISPN000082: Stopping the RpcDispatcher for channel ISPN 09:59:07,385 DEBUG (testng-Test:[]) [DefaultCacheManager] Stopping cache manager ISPN on Test-NodeB-10318 09:59:07,385 TRACE (testng-Test:[]) [DefaultCacheManager] Cache stop order: [DistInitialTransferListener] 09:59:07,385 TRACE (testng-Test:[]) [DefaultCacheManager] Ignoring cache DistInitialTransferListener, it is already terminated. 09:59:07,385 TRACE (testng-Test:[]) [LocalTopologyManagerImpl] Stopping LocalTopologyManager on Test-NodeB-10318 09:59:07,385 INFO (testng-Test:[]) [JGroupsTransport] ISPN000080: Disconnecting JGroups channel ISPN 09:59:07,385 TRACE (testng-Test:[]) [GMS] Test-NodeB-10318: sending LEAVE request to Test-NodeA-7051 09:59:07,385 TRACE (testng-Test:[]) [UNICAST3] Test-NodeB-10318 --> DATA(Test-NodeA-7051: #191, conn_id=0) 09:59:07,385 TRACE (testng-Test:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are GMS: GmsHeader[LEAVE_REQ]: mbr=Test-NodeB-10318, UNICAST3: DATA, seqno=191, TP: [cluster_name=ISPN] 09:59:07,386 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:07,388 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (86 bytes) 09:59:07,388 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=0 bytes, flags=OOB], headers are GMS: GmsHeader[LEAVE_REQ]: mbr=Test-NodeB-10318, UNICAST3: DATA, seqno=191, TP: [cluster_name=ISPN] 09:59:07,388 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #191, conn_id=0) 09:59:07,388 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeB-10318#191 09:59:07,388 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: joiners=[], suspected=[], leaving=[Test-NodeB-10318], new view: [Test-NodeA-7051|4] (1) [Test-NodeA-7051] 09:59:07,388 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: sending LEAVE response to Test-NodeB-10318 09:59:07,388 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster_name=ISPN] 09:59:07,388 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: mcasting view [Test-NodeA-7051|4] (1) [Test-NodeA-7051] (1 mbrs) 09:59:07,389 TRACE (NioConnection.Reader [127.0.0.1:7900],Test-NodeB-10318:[]) [TCP_NIO2] 127.0.0.1:7901: removed connection to 127.0.0.1:7900 09:59:07,389 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (57 bytes (285.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:07,401 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (60 bytes) 09:59:07,389 TRACE (ViewHandler,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: sending Test-NodeA-7051#11 09:59:07,402 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] 127.0.0.1:7900: connecting to 127.0.0.1:7901 09:59:07,402 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to null, src=Test-NodeA-7051, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 09:59:07,402 TRACE (ViewHandler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes] 09:59:07,402 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: , src: Test-NodeA-7051 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 09:59:07,402 TRACE (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: received Test-NodeA-7051#11 09:59:07,402 TRACE (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: delivering Test-NodeA-7051#11-11 (1 messages) 09:59:07,402 TRACE (Incoming-1,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: received delta view [Test-NodeA-7051|4], ref-view=[Test-NodeA-7051|3], left=[Test-NodeB-10318] 09:59:07,402 DEBUG (Incoming-1,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: installing view [Test-NodeA-7051|4] (1) [Test-NodeA-7051] 09:59:07,402 TRACE (Incoming-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: closing connections of non members [Test-NodeB-10318, Test-NodeC-52778] 09:59:07,402 DEBUG (Incoming-1,Test-NodeA-7051:[]) [NAKACK2] Test-NodeA-7051: removed Test-NodeB-10318 from xmit_table (not member anymore) 09:59:07,402 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (112 bytes (560.00% of max_bundle_size) to 1 dests(s): [ISPN] 09:59:07,402 TRACE (Incoming-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: reset digest to Test-NodeA-7051: [-1] 09:59:07,402 TRACE (Incoming-1,Test-NodeA-7051:[]) [TOA] Handle view [Test-NodeA-7051|4] (1) [Test-NodeA-7051] 09:59:07,410 TRACE (Incoming-1,Test-NodeA-7051:[]) [MFC] new membership: [Test-NodeA-7051] 09:59:07,411 TRACE (Incoming-1,Test-NodeA-7051:[]) [FRAG2] Test-NodeA-7051: removed Test-NodeB-10318 from fragmentation table 09:59:07,412 DEBUG (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] New view accepted: [Test-NodeA-7051|4] (1) [Test-NodeA-7051] 09:59:07,416 DEBUG (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] Joined: [], Left: [Test-NodeB-10318] 09:59:07,417 INFO (Incoming-1,Test-NodeA-7051:[]) [JGroupsTransport] ISPN000094: Received new cluster view for channel ISPN: [Test-NodeA-7051|4] (1) [Test-NodeA-7051] 09:59:07,417 TRACE (Incoming-1,Test-NodeA-7051:[]) [SemaphoreCompletionService] New task submitted, tasks in queue 1, available permits 1 09:59:07,418 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [SemaphoreCompletionService] Task started, tasks in queue 0, available permits 0 09:59:07,419 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [ClusterTopologyManagerImpl] Received new cluster view: 4, isCoordinator = true, old status = COORDINATOR 09:59:07,419 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [ClusterTopologyManagerImpl] Updating cluster members for all the caches. New list is [Test-NodeA-7051] 09:59:07,419 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=Test-NodeA-7051, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 09:59:07,419 TRACE (transport-thread-Test-NodeA-p23728-t2:[]) [SemaphoreCompletionService] Task finished, tasks in queue 0, available permits 0 09:59:07,417 INFO (Incoming-1,Test-NodeA-7051:[]) [CLUSTER] ISPN100001: Node Test-NodeB-10318 left the cluster 09:59:07,419 TRACE (Incoming-1,Test-NodeA-7051:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051], oldMembers=[Test-NodeA-7051, Test-NodeB-10318], localAddress=Test-NodeA-7051, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125904201809920 09:59:07,419 TRACE (Incoming-1,Test-NodeA-7051:[]) [NumericVersionGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[Test-NodeA-7051], oldMembers=[Test-NodeA-7051, Test-NodeB-10318], localAddress=Test-NodeA-7051, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125904201809920 09:59:07,420 TRACE (Incoming-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> DATA(Test-NodeA-7051: #4, conn_id=0) 09:59:07,420 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeA-7051, src=Test-NodeA-7051, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 09:59:07,420 TRACE (Incoming-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: looping back message [dst: Test-NodeA-7051, src: Test-NodeA-7051 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 09:59:07,420 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeA-7051 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 09:59:07,420 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeA-7051: #4, conn_id=0) 09:59:07,420 TRACE (INT-1,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051: delivering Test-NodeA-7051#4 09:59:07,421 TRACE (ViewHandler,Test-NodeA-7051:[]) [GMS] Test-NodeA-7051: got all ACKs (1) from members for view [Test-NodeA-7051|4] 09:59:07,486 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeA-7051: #187) 09:59:07,486 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=187, conn_id=1, ts=105, TP: [cluster_name=ISPN] 09:59:07,487 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> ACK(Test-NodeC-52778: #80) 09:59:07,487 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are UNICAST3: ACK, seqno=80, conn_id=1, ts=106, TP: [cluster_name=ISPN] 09:59:07,487 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:Test-NodeC-52778, ISPN:Test-NodeA-7051] 09:59:07,494 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (63 bytes) 09:59:07,494 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] 127.0.0.1:7901: connecting to 127.0.0.1:7902 09:59:07,499 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (63 bytes) 09:59:07,499 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] 127.0.0.1:7901: connecting to 127.0.0.1:7900 09:59:07,533 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #191) 09:59:07,534 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=191, ts=124, TP: [cluster_name=ISPN] 09:59:07,534 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeC-52778: #329) 09:59:07,534 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=329, ts=125, TP: [cluster_name=ISPN] 09:59:07,534 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:07,542 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:07,542 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] 127.0.0.1:7900: connecting to 127.0.0.1:7901 09:59:07,544 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:07,544 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (64 bytes) 09:59:07,544 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] 127.0.0.1:7900: connecting to 127.0.0.1:7902 09:59:07,552 TRACE (INT-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=187, conn_id=1, ts=105, TP: [cluster_name=ISPN] 09:59:07,552 TRACE (INT-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- ACK(Test-NodeB-10318: #187, conn-id=1, ts=105) 09:59:07,987 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> XMIT(Test-NodeA-7051: #191) 09:59:07,987 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are GMS: GmsHeader[LEAVE_REQ]: mbr=Test-NodeB-10318, UNICAST3: DATA, seqno=191, TP: [cluster_name=ISPN] 09:59:07,987 TRACE (Timer-2,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 --> XMIT(Test-NodeC-52778: #80) 09:59:07,987 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:07,987 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (86 bytes) 09:59:07,987 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeC-52778, src=Test-NodeB-10318, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92149, rsp_expected=true, UNICAST3: DATA, seqno=80, conn_id=1, TP: [cluster_name=ISPN] 09:59:07,987 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:07,987 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7902 (80 bytes) 09:59:07,987 TRACE (OOB-2,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (3 headers), size=0 bytes, flags=OOB], headers are GMS: GmsHeader[LEAVE_REQ]: mbr=Test-NodeB-10318, UNICAST3: DATA, seqno=191, TP: [cluster_name=ISPN] 09:59:07,987 TRACE (OOB-2,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 <-- DATA(Test-NodeB-10318: #191, conn_id=0) 09:59:07,987 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] 127.0.0.1:7901: connecting to 127.0.0.1:7902 09:59:08,042 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> ACK(Test-NodeB-10318: #191) 09:59:08,042 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeB-10318, src=Test-NodeA-7051, headers are UNICAST3: ACK, seqno=191, ts=126, TP: [cluster_name=ISPN] 09:59:08,046 TRACE (Timer-3,Test-NodeA-7051:[]) [UNICAST3] Test-NodeA-7051 --> XMIT(Test-NodeC-52778: #325) 09:59:08,046 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeB-10318] 09:59:08,046 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7901 (63 bytes) 09:59:08,046 TRACE (INT-1,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: received [dst: Test-NodeB-10318, src: Test-NodeA-7051 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=191, ts=126, TP: [cluster_name=ISPN] 09:59:08,046 TRACE (INT-1,Test-NodeB-10318:[]) [UNICAST3] Test-NodeB-10318 <-- ACK(Test-NodeA-7051: #191, conn-id=0, ts=126) 09:59:08,046 TRACE (Timer-3,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending msg to Test-NodeC-52778, src=Test-NodeA-7051, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=92141, rsp_expected=true, UNICAST3: DATA, seqno=325, conn_id=2, TP: [cluster_name=ISPN] 09:59:08,047 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: sending 1 msgs (79 bytes (395.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeC-52778] 09:59:08,048 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] dest=127.0.0.1:7902 (82 bytes) 09:59:08,051 TRACE (TransferQueueBundler,Test-NodeA-7051:[]) [TCP_NIO2] 127.0.0.1:7900: connecting to 127.0.0.1:7902 09:59:08,334 TRACE (Timer-2,Test-NodeB-10318:[]) [STABLE] Test-NodeB-10318: sending stable msg to Test-NodeA-7051: Test-NodeA-7051: [10], Test-NodeB-10318: [0] 09:59:08,336 TRACE (Timer-2,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending msg to Test-NodeA-7051, src=Test-NodeB-10318, headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|3], TP: [cluster_name=ISPN] 09:59:08,336 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] Test-NodeB-10318: sending 1 msgs (119 bytes (595.00% of max_bundle_size) to 1 dests(s): [ISPN:Test-NodeA-7051] 09:59:08,337 TRACE (TransferQueueBundler,Test-NodeB-10318:[]) [TCP_NIO2] dest=127.0.0.1:7900 (122 bytes) 09:59:08,337 TRACE (INT-1,Test-NodeA-7051:[]) [TCP_NIO2] Test-NodeA-7051: received [dst: Test-NodeA-7051, src: Test-NodeB-10318 (2 headers), size=41 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [Test-NodeA-7051|3], TP: [cluster_name=ISPN] 09:59:08,337 TRACE (INT-1,Test-NodeA-7051:[]) [STABLE] Test-NodeA-7051: discarded STABLE message with different view-id [Test-NodeA-7051|3] (my view-id=[Test-NodeA-7051|4]) 09:59:08,467 TRACE (NioConnection.Reader [null],Test-NodeA-7051:[]) [TCP_NIO2] 127.0.0.1:7900: removed connection to 127.0.0.1:7901 09:59:08,467 DEBUG (testng-Test:[]) [TEST_PING] Stop discovery for Test-NodeB-10318 09:59:08,472 DEBUG (testng-Test:[]) [TCP_NIO2] closing sockets and stopping threads 09:59:08,477 INFO (testng-Test:[]) [JGroupsTransport] ISPN000082: Stopping the RpcDispatcher for channel ISPN 09:59:08,481 DEBUG (testng-Test:[]) [DefaultCacheManager] Stopping cache manager ISPN on Test-NodeA-7051 09:59:08,491 TRACE (testng-Test:[]) [DefaultCacheManager] Cache stop order: [DistInitialTransferListener] 09:59:08,492 TRACE (testng-Test:[]) [DefaultCacheManager] Ignoring cache DistInitialTransferListener, it is already terminated. 09:59:08,494 TRACE (testng-Test:[]) [LocalTopologyManagerImpl] Stopping LocalTopologyManager on Test-NodeA-7051 09:59:08,494 INFO (testng-Test:[]) [JGroupsTransport] ISPN000080: Disconnecting JGroups channel ISPN 09:59:08,496 DEBUG (testng-Test:[]) [TEST_PING] Stop discovery for Test-NodeA-7051 09:59:08,499 DEBUG (testng-Test:[]) [TCP_NIO2] closing sockets and stopping threads 09:59:08,500 INFO (testng-Test:[]) [JGroupsTransport] ISPN000082: Stopping the RpcDispatcher for channel ISPN 09:59:08,502 DEBUG (testng-Test:[]) [TestNGTestListener] After setup destroy 09:59:08,503 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup testClassFinished 09:59:08,504 DEBUG (testng-Test:[]) [TestNGTestListener] After setup testClassFinished 09:59:08,506 DEBUG (testng-Test:[]) [TestNGTestListener] Before setup testClassStarted