[dan@localhost]~/Downloads/mlinhard/ispn-1838-trace% ./checkTimes.py node0?.log node01.log 60.364 : 05:58:36,903 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (undefined) Replication task sending StateTransferControlCommand{cache=testCache, type=APPLY_STATE, sender=edg-perf01/default, viewId=6, state=4084} to addresses [edg-perf02/default] 05:58:36,903 TRACE [org.infinispan.marshall.VersionAwareMarshaller] (undefined) Wrote version 510 05:58:36,903 TRACE [org.infinispan.marshall.VersionAwareMarshaller] (undefined) Wrote version 510 05:58:36,934 TRACE [org.infinispan.marshall.jboss.AbstractJBossMarshaller] (undefined) Stop marshaller 05:58:36,939 TRACE [org.infinispan.marshall.jboss.AbstractJBossMarshaller] (undefined) Stop marshaller 05:58:36,939 FINER [org.jgroups.blocks.Request] (undefined) sending request (id=7759) 05:58:36,939 FINER [org.jgroups.protocols.FRAG2] (undefined) message's buffer size is 4359970, will fragment (frag_size=60000) 05:58:36,939 FINER [org.jgroups.protocols.FRAG2] (undefined) fragmenting packet to edg-perf02/default (size=4359970) into 73 fragment(s) [frag_size=60000] 05:58:36,939 FINER [org.jgroups.protocols.UNICAST2] (undefined) edg-perf01/default --> DATA(edg-perf02/default: #3, conn_id=3) 05:58:36,939 FINER [org.jgroups.protocols.UDP] (undefined) sending msg to edg-perf02/default, src=edg-perf01/default, headers are RequestCorrelator: id=200, type=REQ, id=7759, rsp_expected=true, FRAG2: [id=3, frag_id=0, num_frags=73], UNICAST2: DATA, seqno=3, conn_id=3, UDP: [channel_name=default] 05:58:36,940 FINER [org.jgroups.protocols.UNICAST2] (undefined) edg-perf01/default --> DATA(edg-perf02/default: #4, conn_id=3) 05:58:36,940 FINER [org.jgroups.protocols.UDP] (undefined) sending msg to edg-perf02/default, src=edg-perf01/default, headers are FRAG2: [id=3, frag_id=1, num_frags=73], UNICAST2: DATA, seqno=4, conn_id=3, UDP: [channel_name=default] 05:58:36,941 FINER [org.jgroups.protocols.UNICAST2] (undefined) edg-perf01/default --> DATA(edg-perf02/default: #5, conn_id=3) 05:58:36,941 FINER [org.jgroups.protocols.UDP] (undefined) sending msg to edg-perf02/default, src=edg-perf01/default, headers are FRAG2: [id=3, frag_id=2, num_frags=73], UNICAST2: DATA, seqno=5, conn_id=3, UDP: [channel_name=default] 05:58:37,315 FINER [org.jgroups.protocols.UDP] (undefined) received [dst: edg-perf01/default, src: edg-perf02/default (2 headers), size=0 bytes], headers are UNICAST2: XMIT_REQ, seqno=59, UDP: [channel_name=default] 05:58:37,315 FINER [org.jgroups.protocols.UNICAST2] (undefined) edg-perf01/default <-- XMIT(edg-perf02/default: #59-69) 05:58:37,916 FINER [org.jgroups.protocols.UDP] (undefined) received [dst: edg-perf01/default, src: edg-perf02/default (2 headers), size=0 bytes], headers are UNICAST2: XMIT_REQ, seqno=61, UDP: [channel_name=default] 05:58:37,916 FINER [org.jgroups.protocols.UNICAST2] (undefined) edg-perf01/default <-- XMIT(edg-perf02/default: #61-69) 05:58:39,116 FINER [org.jgroups.protocols.UDP] (undefined) received [dst: edg-perf01/default, src: edg-perf02/default (2 headers), size=0 bytes], headers are UNICAST2: XMIT_REQ, seqno=63, UDP: [channel_name=default] 05:58:39,117 FINER [org.jgroups.protocols.UNICAST2] (undefined) edg-perf01/default <-- XMIT(edg-perf02/default: #63-67) *** 05:59:34,927 FINER [org.jgroups.protocols.UDP] (undefined) received [dst: edg-perf01/default, src: edg-perf02/default (2 headers), size=0 bytes, flags=OOB], headers are UNICAST2: STABLE, seqno=70, conn_id=3, UDP: [channel_name=default] 05:59:34,928 FINER [org.jgroups.protocols.UNICAST2] (undefined) edg-perf01/default <-- STABLE(edg-perf02/default: 70-70, conn_id=3) 05:59:34,928 FINER [org.jgroups.protocols.UDP] (undefined) sending msg to edg-perf02/default, src=edg-perf01/default, headers are FRAG2: [id=3, frag_id=68, num_frags=73], UNICAST2: DATA, seqno=71, conn_id=3, UDP: [channel_name=default] 05:59:34,928 FINER [org.jgroups.protocols.UDP] (undefined) sending msg to edg-perf02/default, src=edg-perf01/default, headers are FRAG2: [id=3, frag_id=69, num_frags=73], UNICAST2: DATA, seqno=72, conn_id=3, UDP: [channel_name=default] 05:59:34,929 FINER [org.jgroups.protocols.UDP] (undefined) sending msg to edg-perf02/default, src=edg-perf01/default, headers are FRAG2: [id=3, frag_id=70, num_frags=73], UNICAST2: DATA, seqno=73, conn_id=3, UDP: [channel_name=default] 05:59:34,929 FINER [org.jgroups.protocols.UDP] (undefined) sending msg to edg-perf02/default, src=edg-perf01/default, headers are FRAG2: [id=3, frag_id=71, num_frags=73], UNICAST2: DATA, seqno=74, conn_id=3, UDP: [channel_name=default] 05:59:34,929 FINER [org.jgroups.protocols.UDP] (undefined) sending msg to edg-perf02/default, src=edg-perf01/default, headers are FRAG2: [id=3, frag_id=72, num_frags=73], UNICAST2: DATA, seqno=75, conn_id=3, UDP: [channel_name=default] 05:59:36,377 FINER [org.jgroups.protocols.UDP] (undefined) received [dst: edg-perf01/default, src: edg-perf03/default (2 headers), size=0 bytes, flags=OOB], headers are FD: heartbeat, UDP: [channel_name=default] 05:59:37,267 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (undefined) Responses: [sender=edg-perf02/default, retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false]