Uploaded image for project: 'Red Hat Fuse'
  1. Red Hat Fuse
  2. ENTESB-2739

Exception happens when trying to delete ssh container several times via Hawtio (and Zookeeper failed to select master)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Obsolete
    • Minor
    • fuse-7.0
    • jboss-fuse-6.2
    • Hawtio
    • None
    • % %
    • Hide
      1. start fuse and fabric
      2. start container test1: 
        fabric:container-create-ssh --user USER --host 127.0.0.1 --new-user admin --new-user-password admin  --profile default --password PASSWORD test1
      3. Optional (to get the problem with Zookeeper) start 3 amq container with replicated LevelDB: 
        mq-create --no-ssl --parent-profile=mq-replicated --group a broker-nossl

profile-edit --config org.apache.activemq.leveldb.test=true --system org.apache.activemq.leveldb.test=true mq-broker-a.broker-nossl

fabric:container-create-ssh --user USER --host 127.0.0.1  --profile mq-broker-a.broker-nossl --password PASSWORD  --new-user admin --new-user-password admin broker-nossl-c0

fabric:container-create-ssh --user USER --host 127.0.0.1  --profile mq-broker-a.broker-nossl --password PASSWORD --new-user admin --new-user-password admin  broker-nossl-c1

fabric:container-create-ssh --user USER --host 127.0.0.1  --profile mq-broker-a.broker-nossl --password PASSWORD --new-user admin --new-user-password admin broker-nossl-c2
      4. open Hawtio and try to Delete test1 container. Repeat the action several times.
      Show
      start fuse and fabric start container test1: fabric:container-create-ssh --user USER --host 127.0.0.1 -- new -user admin -- new -user-password admin --profile default --password PASSWORD test1 Optional (to get the problem with Zookeeper) start 3 amq container with replicated LevelDB: mq-create --no-ssl --parent-profile=mq-replicated --group a broker-nossl profile-edit --config org.apache.activemq.leveldb.test= true --system org.apache.activemq.leveldb.test= true mq-broker-a.broker-nossl fabric:container-create-ssh --user USER --host 127.0.0.1 --profile mq-broker-a.broker-nossl --password PASSWORD -- new -user admin -- new -user-password admin broker-nossl-c0 fabric:container-create-ssh --user USER --host 127.0.0.1 --profile mq-broker-a.broker-nossl --password PASSWORD -- new -user admin -- new -user-password admin broker-nossl-c1 fabric:container-create-ssh --user USER --host 127.0.0.1 --profile mq-broker-a.broker-nossl --password PASSWORD -- new -user admin -- new -user-password admin broker-nossl-c2 open Hawtio and try to Delete test1 container. Repeat the action several times.

    Description

      In fabric when pressing 'Delete' button for some container more than once, the following error is printed to fuse.log, and also Zookeeper fails to select Master for the rest amq containers:

      2015-03-02 13:05:06,402 | ERROR | tp163024037-1378 | SshContainerProvider             | 270 - io.fabric8.fabric-core-agent-ssh - 1.2.0.redhat-074 | Failed to stop container: test1
java.lang.Exception: emedvede@127.0.0.1:22: received exit status 1 executing 
--- command ---
#!/bin/bash
function run { echo "Running: $*" ; $* ; rc=$? ; if [ "${rc}" -ne 0 ]; then echo "Command Failed:Error running installation script: $*" ; exit ${rc} ; fi ; }

function sudo_n {
SUDO_NON_INTERACTIVE=`sudo -h | grep "\-n"`
  if [ -z "$SUDO_NON_INTERACTIVE" ]; then
     sudo $*
  else
     sudo -n $*
  fi
}

function karaf_kill() {
   KARAF_HOME=$1
   INSTANCES_FILE=$KARAF_HOME/instances/instance.properties
   PID=`cat $INSTANCES_FILE | grep "item.0.pid" | awk -F "=" '{print $2}'`
   $KARAF_HOME/bin/stop
      for i in {1..20};
        do
            if ps -p $PID > /dev/null; then
                echo "Fabric has been successfully stopped"
                break
            else
                sleep 3
            fi
        done
      kill -9 $PID
}

run cd ~/containers/
run cd test1
run cd `ls -l | grep fabric8-karaf | grep ^d | awk '{ print $NF }' | sort -n | head -1`
karaf_kill `pwd`
run cd  ../..
run rm -rf test1

--- output ---
Running: cd /home/emedvede/containers/
Running: cd test1
bash: line 1: cd: test1: No such file or directory
Command Failed:Error running installation script: cd test1

--- error ---

------

	at io.fabric8.service.ssh.SshContainerProvider.runScriptOnHost(SshContainerProvider.java:314)
	at io.fabric8.service.ssh.SshContainerProvider.destroy(SshContainerProvider.java:199)
	at io.fabric8.service.FabricServiceImpl.destroyContainer(FabricServiceImpl.java:422)
	at io.fabric8.service.FabricServiceImpl.destroyContainer(FabricServiceImpl.java:393)
	at io.fabric8.service.FabricServiceImpl.destroyContainer(FabricServiceImpl.java:386)
	at io.fabric8.core.jmx.FabricManager.destroyContainer(FabricManager.java:365)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)[:1.7.0_45]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)[:1.7.0_45]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[:1.7.0_45]
	at java.lang.reflect.Method.invoke(Method.java:606)[:1.7.0_45]
	at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:75)[:1.7.0_45]
	at sun.reflect.GeneratedMethodAccessor50.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[:1.7.0_45]
	at java.lang.reflect.Method.invoke(Method.java:606)[:1.7.0_45]
	at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:279)[:1.7.0_45]
	at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112)[:1.7.0_45]
	at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46)[:1.7.0_45]
	at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237)[:1.7.0_45]
	at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:138)[:1.7.0_45]
	at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:252)[:1.7.0_45]
	at javax.management.StandardMBean.invoke(StandardMBean.java:405)[:1.7.0_45]
	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:819)[:1.7.0_45]
	at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:801)[:1.7.0_45]
	at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[:1.7.0_45]
	at java.lang.reflect.Method.invoke(Method.java:606)[:1.7.0_45]
	at org.apache.karaf.management.boot.KarafMBeanServerBuilder$MBeanInvocationHandler.invoke(KarafMBeanServerBuilder.java:66)[karaf-jmx-boot.jar:]
	at com.sun.proxy.$Proxy0.invoke(Unknown Source)[:]
	at org.jolokia.handler.ExecHandler.doHandleRequest(ExecHandler.java:98)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.handler.ExecHandler.doHandleRequest(ExecHandler.java:40)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.handler.JsonRequestHandler.handleRequest(JsonRequestHandler.java:89)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.backend.MBeanServerExecutorLocal.handleRequest(MBeanServerExecutorLocal.java:109)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.backend.MBeanServerHandler.dispatchRequest(MBeanServerHandler.java:102)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.backend.LocalRequestDispatcher.dispatchRequest(LocalRequestDispatcher.java:98)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.backend.BackendManager.callRequestDispatcher(BackendManager.java:411)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.backend.BackendManager.handleRequest(BackendManager.java:158)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.http.HttpRequestHandler.executeRequest(HttpRequestHandler.java:197)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.http.HttpRequestHandler.handlePostRequest(HttpRequestHandler.java:137)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.http.AgentServlet$3.handleRequest(AgentServlet.java:425)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.http.AgentServlet.handleSecurely(AgentServlet.java:320)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.http.AgentServlet.handle(AgentServlet.java:291)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.jolokia.http.AgentServlet.doPost(AgentServlet.java:259)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:595)[90:org.apache.geronimo.specs.geronimo-servlet_3.0_spec:1.0.0]
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)[90:org.apache.geronimo.specs.geronimo-servlet_3.0_spec:1.0.0]
	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1496)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at io.hawt.web.AuthenticationFilter$2.run(AuthenticationFilter.java:166)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at java.security.AccessController.doPrivileged(Native Method)[:1.7.0_45]
	at javax.security.auth.Subject.doAs(Subject.java:415)[:1.7.0_45]
	at io.hawt.web.AuthenticationFilter.executeAs(AuthenticationFilter.java:163)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at io.hawt.web.AuthenticationFilter.doFilter(AuthenticationFilter.java:130)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1467)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at io.hawt.web.XFrameOptionsFilter.doFilter(XFrameOptionsFilter.java:28)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1467)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at io.hawt.web.CORSFilter.doFilter(CORSFilter.java:42)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1467)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at io.hawt.web.CacheHeadersFilter.doFilter(CacheHeadersFilter.java:37)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1467)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at io.hawt.web.SessionExpiryFilter.process(SessionExpiryFilter.java:147)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at io.hawt.web.SessionExpiryFilter.doFilter(SessionExpiryFilter.java:47)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1467)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at io.hawt.web.RedirectFilter.process(RedirectFilter.java:73)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at io.hawt.web.RedirectFilter.doFilter(RedirectFilter.java:38)[254:io.hawt.hawtio-web:1.5.0.redhat-079]
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1467)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.ops4j.pax.web.service.internal.WelcomeFilesFilter.doFilter(WelcomeFilesFilter.java:185)[103:org.ops4j.pax.web.pax-web-runtime:3.1.4]
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1467)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:501)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.ops4j.pax.web.service.jetty.internal.HttpServiceServletHandler.doHandle(HttpServiceServletHandler.java:69)[104:org.ops4j.pax.web.pax-web-jetty:3.1.4]
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:533)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.ops4j.pax.web.service.jetty.internal.HttpServiceContext.doHandle(HttpServiceContext.java:240)[104:org.ops4j.pax.web.pax-web-jetty:3.1.4]
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.ops4j.pax.web.service.jetty.internal.JettyServerHandlerCollection.handle(JettyServerHandlerCollection.java:75)[104:org.ops4j.pax.web.pax-web-jetty:3.1.4]
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.Server.handle(Server.java:370)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:982)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1043)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)[95:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
	at java.lang.Thread.run(Thread.java:744)[:1.7.0_45]
2015-03-02 13:05:19,029 | WARN  | SyncThread:0     | FileTxnLog                       | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | fsync-ing the write ahead log in SyncThread:0 took 5739ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
2015-03-02 13:05:19,030 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:19,030 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:19,030 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:19,031 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:19,031 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:19,031 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:20,637 | WARN  | SyncThread:0     | FileTxnLog                       | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | fsync-ing the write ahead log in SyncThread:0 took 1605ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
2015-03-02 13:05:25,913 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,914 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,914 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,914 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,914 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,915 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,915 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,915 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,915 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,915 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,916 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,916 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,916 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,916 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,918 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,919 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,919 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,920 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,920 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,920 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,921 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,921 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,921 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,922 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,922 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,922 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,922 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.setWatches(DataTree.java:1286)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.setWatches(ZKDatabase.java:384)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:304)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:25,922 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:26,192 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.deleteNode(DataTree.java:594)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.killSession(DataTree.java:966)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:818)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:26,193 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.deleteNode(DataTree.java:594)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.killSession(DataTree.java:966)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:818)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:26,193 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.deleteNode(DataTree.java:594)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.killSession(DataTree.java:966)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:818)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:26,193 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.deleteNode(DataTree.java:594)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.killSession(DataTree.java:966)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:818)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:26,193 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.deleteNode(DataTree.java:594)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.killSession(DataTree.java:966)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:818)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:26,194 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:26,194 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
2015-03-02 13:05:26,194 | ERROR | SyncThread:0     | NIOServerCnxn                    | 85 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-074 | Unexpected Exception: 
java.nio.channels.CancelledKeyException
	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)[:1.7.0_45]
	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)[:1.7.0_45]
	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]
	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)[85:io.fabric8.fabric-zookeeper:1.2.0.redhat-074]

      Attachments

        Activity

          People

            rhn-support-tasato Tadayoshi Sato
            emedvede Elena Medvedeva (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: