Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-2968

bdbje - fail to start clustered

    XMLWordPrintable

Details

    Description

      with bdbje store I can start a server and everything seems to be working fine. Without a cache store I can start a cluster of two servers and everything seems to be working fine. But having configured bdbje backend and trying to start a second server serults in exceptions like these:

      22:55:15,479 ERROR [org.infinispan.transaction.TransactionCoordinator] (OOB-11,koTapaH-7896) Error while processing prepare: org.infinispan.CacheException: org.infinispan.loaders.CacheLoaderException: Problem preparing transaction
      	at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:351) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.transaction.TransactionCoordinator.prepare(TransactionCoordinator.java:141) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.transaction.TransactionCoordinator.prepare(TransactionCoordinator.java:123) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.transaction.synchronization.SynchronizationAdapter.beforeCompletion(SynchronizationAdapter.java:68) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at com.arjuna.ats.internal.jta.resources.arjunacore.SynchronizationImple.beforeCompletion(SynchronizationImple.java:76)
      	at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.beforeCompletion(TwoPhaseCoordinator.java:273)
      	at com.arjuna.ats.arjuna.coordinator.TwoPhaseCoordinator.end(TwoPhaseCoordinator.java:93)
      	at com.arjuna.ats.arjuna.AtomicAction.commit(AtomicAction.java:164)
      	at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.commitAndDisassociate(TransactionImple.java:1165)
      	at com.arjuna.ats.internal.jta.transaction.arjunacore.BaseTransaction.commit(BaseTransaction.java:117)
      	at com.arjuna.ats.jbossatx.BaseTransactionManagerDelegate.commit(BaseTransactionManagerDelegate.java:75)
      	at org.infinispan.statetransfer.StateConsumerImpl.doApplyState(StateConsumerImpl.java:488) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.statetransfer.StateConsumerImpl.applyState(StateConsumerImpl.java:432) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.statetransfer.StateResponseCommand.perform(StateResponseCommand.java:86) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.remoting.InboundInvocationHandlerImpl.handleInternal(InboundInvocationHandlerImpl.java:101) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.remoting.InboundInvocationHandlerImpl.handleWithWaitForBlocks(InboundInvocationHandlerImpl.java:122) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.remoting.InboundInvocationHandlerImpl.handle(InboundInvocationHandlerImpl.java:86) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.executeCommandFromLocalCluster(CommandAwareRpcDispatcher.java:247) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.handle(CommandAwareRpcDispatcher.java:220) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.jgroups.blocks.RequestCorrelator.handleRequest(RequestCorrelator.java:472) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.blocks.RequestCorrelator.receiveMessage(RequestCorrelator.java:377) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.blocks.RequestCorrelator.receive(RequestCorrelator.java:247) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.up(MessageDispatcher.java:664) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.JChannel.up(JChannel.java:719) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:1008) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.RSVP.up(RSVP.java:163) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.FRAG2.up(FRAG2.java:161) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.FlowControl.up(FlowControl.java:404) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.FlowControl.up(FlowControl.java:386) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.pbcast.GMS.up(GMS.java:893) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:234) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.UNICAST2.handleDataReceived(UNICAST2.java:790) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.UNICAST2.up(UNICAST2.java:411) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.pbcast.NAKACK2.up(NAKACK2.java:609) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:147) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:184) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:286) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.MERGE2.up(MERGE2.java:206) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.Discovery.up(Discovery.java:375) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.TP.passMessageUp(TP.java:1350) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at org.jgroups.protocols.TP$MyHandler.run(TP.java:1491) [jgroups-3.3.0.CR1.jar:3.3.0.CR1]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_09-icedtea]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_09-icedtea]
      	at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea]
      Caused by: org.infinispan.loaders.CacheLoaderException: Problem preparing transaction
      	at org.infinispan.loaders.bdbje.BdbjeCacheStore.convertToCacheLoaderException(BdbjeCacheStore.java:589) [infinispan-cachestore-bdbje-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.loaders.bdbje.BdbjeCacheStore.prepare(BdbjeCacheStore.java:315) [infinispan-cachestore-bdbje-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.loaders.bdbje.BdbjeCacheStore.prepare(BdbjeCacheStore.java:274) [infinispan-cachestore-bdbje-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.CacheStoreInterceptor.prepareCacheLoader(CacheStoreInterceptor.java:303) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.DistCacheStoreInterceptor.visitPrepareCommand(DistCacheStoreInterceptor.java:158) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:126) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.EntryWrappingInterceptor.visitPrepareCommand(EntryWrappingInterceptor.java:106) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.locking.AbstractTxLockingInterceptor.invokeNextAndCommitIf1Pc(AbstractTxLockingInterceptor.java:108) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.locking.OptimisticLockingInterceptor.visitPrepareCommand(OptimisticLockingInterceptor.java:135) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.NotificationInterceptor.visitPrepareCommand(NotificationInterceptor.java:58) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:126) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.TxInterceptor.invokeNextInterceptorAndVerifyTransaction(TxInterceptor.java:128) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.TxInterceptor.visitPrepareCommand(TxInterceptor.java:115) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:126) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.statetransfer.TransactionSynchronizerInterceptor.visitPrepareCommand(TransactionSynchronizerInterceptor.java:61) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.statetransfer.StateTransferInterceptor.handleTopologyAffectedCommand(StateTransferInterceptor.java:216) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.statetransfer.StateTransferInterceptor.handleTxCommand(StateTransferInterceptor.java:189) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.statetransfer.StateTransferInterceptor.visitPrepareCommand(StateTransferInterceptor.java:93) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:126) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.handleDefault(CommandInterceptor.java:132) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:126) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.base.CommandInterceptor.invokeNextInterceptor(CommandInterceptor.java:118) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.InvocationContextInterceptor.handleAll(InvocationContextInterceptor.java:128) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.InvocationContextInterceptor.handleDefault(InvocationContextInterceptor.java:92) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.AbstractVisitor.visitPrepareCommand(AbstractVisitor.java:126) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.commands.tx.PrepareCommand.acceptVisitor(PrepareCommand.java:124) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.interceptors.InterceptorChain.invoke(InterceptorChain.java:343) [infinispan-core-5.2.5.Final.jar:5.2.5.Final]
      	... 43 more
      Caused by: java.io.NotSerializableException: org.infinispan.io.ImmutableMarshalledValueByteStream
      	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1180) [rt.jar:1.7.0_09-icedtea]
      	at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1528) [rt.jar:1.7.0_09-icedtea]
      	at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1493) [rt.jar:1.7.0_09-icedtea]
      	at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1416) [rt.jar:1.7.0_09-icedtea]
      	at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1174) [rt.jar:1.7.0_09-icedtea]
      	at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:346) [rt.jar:1.7.0_09-icedtea]
      	at com.sleepycat.bind.serial.SerialBinding.objectToEntry(SerialBinding.java:179) [je-5.0.34.jar:5.0.34]
      	at com.sleepycat.collections.DataView.useKey(DataView.java:502) [je-5.0.34.jar:5.0.34]
      	at com.sleepycat.collections.DataCursor.initForPut(DataCursor.java:805) [je-5.0.34.jar:5.0.34]
      	at com.sleepycat.collections.DataCursor.put(DataCursor.java:751) [je-5.0.34.jar:5.0.34]
      	at com.sleepycat.collections.StoredContainer.putKeyValue(StoredContainer.java:321) [je-5.0.34.jar:5.0.34]
      	at com.sleepycat.collections.StoredMap.put(StoredMap.java:279) [je-5.0.34.jar:5.0.34]
      	at org.infinispan.loaders.bdbje.BdbjeCacheStore.store(BdbjeCacheStore.java:429) [infinispan-cachestore-bdbje-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.loaders.bdbje.ModificationsTransactionWorker.doWork(ModificationsTransactionWorker.java:66) [infinispan-cachestore-bdbje-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.loaders.bdbje.PreparableTransactionRunner.prepare(PreparableTransactionRunner.java:78) [infinispan-cachestore-bdbje-5.2.5.Final.jar:5.2.5.Final]
      	at org.infinispan.loaders.bdbje.BdbjeCacheStore.prepare(BdbjeCacheStore.java:309) [infinispan-cachestore-bdbje-5.2.5.Final.jar:5.2.5.Final]
      	... 93 more

      Attachments

        Activity

          People

            pruivo@redhat.com Pedro Ruivo
            akostadi1@redhat.com Aleksandar Kostadinov
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: