Uploaded image for project: 'Red Hat Fuse'
  1. Red Hat Fuse
  2. ENTESB-2111

Listener (io.fabric8.service.FabricMBeanRegistrationListener) exception when curator connection SUSPENDED / RECONNECTED

    XMLWordPrintable

Details

    • % %
    • Hide
      1. Create fuse OSE gear, create "fuse2" openshift cartridge with just the "default" profile
      2. ssh to the fuse2 gear, watch the karaf logs
      3. ssh to the fuse gear, use jps to get the java process PID
      4. on the fuse gear, kill -STOP <pid>
      5. wait till the fuse2 gear karaf logs contains ConnectionStateManager State change: SUSPENDED
      6. on the fuse gear, kill -CONT <pid>
      7. notice the connection is back in RECONNECTED, notice the ERROR in the fuse2 logs
      Show
      Create fuse OSE gear, create "fuse2" openshift cartridge with just the "default" profile ssh to the fuse2 gear, watch the karaf logs ssh to the fuse gear, use jps to get the java process PID on the fuse gear, kill -STOP <pid> wait till the fuse2 gear karaf logs contains ConnectionStateManager State change: SUSPENDED on the fuse gear, kill -CONT <pid> notice the connection is back in RECONNECTED, notice the ERROR in the fuse2 logs

    Description

      Having an empty (just the default profile) container connected to a single ensemble server, the following exception is reported as ERROR in the logs when the connection state to ensemble server is SUSPENDED / RECONNECTED

      java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27458911 rejected from java.util.concurrent.ThreadPoolExecutor@4629cf3b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 9]
  at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)[:1.7.0_71]
  at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)[:1.7.0_71]
  at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)[:1.7.0_71]
  at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)[:1.7.0_71]
  at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:638)[:1.7.0_71]
  at io.fabric8.service.FabricMBeanRegistrationListener.stateChanged(FabricMBeanRegistrationListener.java:141)[io.fabric8:fabric-core:1.0.0.redhat-412]
  at org.apache.curator.framework.state.ConnectionStateManager$2.apply(ConnectionStateManager.java:189)[io.fabric8:fabric-zookeeper:1.0.0.redhat-412]
  at org.apache.curator.framework.state.ConnectionStateManager$2.apply(ConnectionStateManager.java:185)[io.fabric8:fabric-zookeeper:1.0.0.redhat-412]
  at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92)[io.fabric8:fabric-zookeeper:1.0.0.redhat-412]
  at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)[com.google.guava:guava:15.0]
  at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83)[io.fabric8:fabric-zookeeper:1.0.0.redhat-412]
  at org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:182)[io.fabric8:fabric-zookeeper:1.0.0.redhat-412]
  at org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:42)[io.fabric8:fabric-zookeeper:1.0.0.redhat-412]
  at org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:108)[io.fabric8:fabric-zookeeper:1.0.0.redhat-412]
  at java.util.concurrent.FutureTask.run(FutureTask.java:262)[:1.7.0_71]
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7.0_71]
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7.0_71]
  at java.lang.Thread.run(Thread.java:745)[:1.7.0_71]

      2014-10-20 13:06:13 INFOorg.apache.curator.framework.state.ConnectionStateManager State change: SUSPENDED
2014-10-20 13:06:16 INFOorg.apache.curator.framework.state.ConnectionStateManager State change: RECONNECTED
2014-10-20 13:06:16 ERRORorg.apache.curator.framework.listen.ListenerContainer Listener (io.fabric8.service.FabricMBeanRegistrationListener@4de34498) threw an exception

      Attachments

        Issue Links

          is related to

          Bug - A problem that impairs or prevents the functions of the product. ENTESB-1801 ActiveMQ stays disconnected from the group after zookeeper connection SUSPENDED / RECONNECED

          • Critical - To be worked on immediately following BLOCKER issues.
          • Closed

          Bug - A problem that impairs or prevents the functions of the product. ENTESB-2085 NPE in org.fusesource.mq.fabric.ActiveMQServiceFactory...$1.apply when redeploying mq-amq containers

          • Minor - To be worked after urgent, high, and medium priorities are resolved. This term is chosen when the severity of the issue is low, or the complexity or effort to correct it may be higher, relatively speaking. For low priority issues, known workarounds exist or are not needed due to the trivial effort needed to address the issue.
          • Closed
          relates to

          Bug - A problem that impairs or prevents the functions of the product. ENTESB-2932 Brokers are stopped after zk connection timout and reconnect

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Activity

            People

              ggrzybek Grzegorz Grzybek
              maschmid@redhat.com Marek Schmidt
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: